00000001:02000400:2.0F:1788812922.025477:0:3303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788812933.911745:0:3502:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788812935.305698:0:3564:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 903 MB/s 00000001:01000000:3.0:1788812935.555486:0:3564:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 855 MB/s 00000001:01000000:3.0:1788812935.805204:0:3564:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5707 MB/s 00000020:02000000:0.0F:1788812936.275500:0:3594:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_41_g50dbf09 00000400:02000000:3.0:1788812936.873207:0:3609:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.113@tcp [8/256/0/180] 00008000:02000000:1.0F:1788812939.617188:0:3758:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788812970.947319:0:5721:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788812977.952379:0:6470:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788812977.952384:0:6470:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788812977.952386:0:6470:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788812977.952539:0:6470:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000025dcdd35 00000080:02000400:0.0:1788812977.952549:0:6470:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788812977.956340:0:6470:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788812977.956351:0:6470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788812977.956376:0:6470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000009aa56520) 00000020:00000080:0.0:1788812977.956393:0:6470:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788812977.982701:0:6470:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788812977.982745:0:6470:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1788812977.995512:0:6470:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788812977.995745:0:6470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788812977.995752:0:6470:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788812977.995762:0:6470:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff7024fb 00000020:01000004:0.0:1788812977.995769:0:6470:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788812977.995774:0:6470:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788812977.995777:0:6470:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000025dcdd35 from MGS 00000020:01000004:0.0:1788812977.995782:0:6470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788812977.995803:0:6470:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000006f8a4369) 00000020:00000080:0.0:1788812977.995813:0:6470:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788812977.995866:0:6470:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000025dcdd35 from MGS, refs=2 00080000:01000000:0.0:1788812977.995870:0:6470:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788812977.995875:0:6470:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff702509 00000100:00100000:0.0:1788812977.996041:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788812977.996184:0:6470:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788812977.996189:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788812977.996440:0:6470:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788812977.996448:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788812977.999332:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788812977.999514:0:6470:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788812977.999520:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788812978.000293:0:6470:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788812978.000302:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788812978.000707:0:6470:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788812978.000714:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788812978.001534:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788812978.001538:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788812978.001539:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788812978.002083:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788812978.002087:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788812978.002095:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788812978.002752:0:6470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788812978.005063:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788812978.252121:0:6470:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 6279 MB/s 00000001:01000000:1.0:1788812978.501962:0:6470:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7539 MB/s 00000001:01000000:1.0:1788812978.752172:0:6470:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1351 MB/s 00000001:01000000:0.0:1788812979.002025:0:6470:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1343 MB/s 00080000:10000000:0.0:1788812979.005772:0:6470:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1788812979.012339:0:6470:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788812979.012979:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788812979.013019:0:6470:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788812979.013051:0:6470:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788812979.013177:0:6470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788812979.013195:0:6470:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788812979.013471:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788812979.013611:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788812979.013616:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788812979.014134:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788812979.014140:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788812979.014348:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788812979.014354:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788812979.014894:0:6470:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788812979.014912:0:6470:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.113@tcp' 00000020:01000004:1.0:1788812979.014914:0:6470:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788812979.014985:0:6470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.113@tcp (typ=mgc) 00000020:00000080:1.0:1788812979.015004:0:6470:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.113@tcp (000000000f9c5f65) 00000020:00000080:1.0:1788812979.015019:0:6470:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788812979.015125:0:6470:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002b8b6581@MGC192.168.202.113@tcp: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788812979.015258:0:6470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.113@tcp-0 is initialized 00000040:01000000:1.0:1788812979.015263:0:6470:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788812979.015783:0:6489:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788812979.025339:0:6492:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788812979.027111:0:6470:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.113@tcp (uuid 064264df-8ee4-4cbf-a8c5-6a62aca32881) 00000020:00000080:2.0:1788812979.027133:0:6470:0:(genops.c:1384:class_connect()) connect: client 064264df-8ee4-4cbf-a8c5-6a62aca32881, cookie 0xf32533d6ff702517 00000100:00080000:2.0:1788812979.027143:0:6470:0:(import.c:545:import_select_connection()) MGC192.168.202.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788812979.027153:0:6470:0:(import.c:666:import_select_connection()) MGC192.168.202.113@tcp: import 000000002b8b6581 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788812979.027194:0:6470:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b4f4c2c5 x1875706313179264/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788812979.027219:0:6470:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 064264df-8ee4-4cbf-a8c5-6a62aca32881->MGS 00000020:01000004:2.0:1788812979.027233:0:6470:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788812979.027238:0:6470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788812979.027255:0:6470:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005f201868) 00000020:00000080:2.0:1788812979.027265:0:6470:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788812979.027449:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4f4c2c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:064264df-8ee4-4cbf-a8c5-6a62aca32881:3624:1875706313179264:0@lo:250: 00000100:00100000:0.0:1788812979.027527:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812979.027628:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313179264 00000100:00100000:1.0:1788812979.027646:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313179264 00000100:00100000:1.0:1788812979.027683:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788812979.027695:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000015fd7ea2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3624:x1875706313179264:12345-0@lo:250: 00010000:00080000:1.0:1788812979.027714:0:6486:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 064264df-8ee4-4cbf-a8c5-6a62aca32881@0@lo t0 exp 0000000000000000 cur 132 last 0 00000020:00000080:1.0:1788812979.027739:0:6486:0:(genops.c:1384:class_connect()) connect: client 064264df-8ee4-4cbf-a8c5-6a62aca32881, cookie 0xf32533d6ff702525 00000100:00080000:1.0:1788812979.027856:0:6486:0:(import.c:65:import_set_state_nolock()) 000000009076d68d : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788812979.027917:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000015fd7ea2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+5:3624:x1875706313179264:12345-0@lo:250: Request processed in 222us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812979.027925:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788812979.027986:0:3624:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788812979.027994:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.113@tcp: connect to target with instance 0 00000100:00080000:1.0:1788812979.028000:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788812979.028004:0:3624:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788812979.028006:0:3624:0:(import.c:65:import_set_state_nolock()) 000000002b8b6581 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788812979.028009:0:3624:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788812979.028018:0:3624:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788812979.028022:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4f4c2c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:064264df-8ee4-4cbf-a8c5-6a62aca32881:3624:1875706313179264:0@lo:250: 00000100:00100000:2.0:1788812979.037193:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788812979.037381:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788812979.037387:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788812979.038317:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788812979.038323:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788812979.038624:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788812979.038630:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788812979.039554:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788812979.039732:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788812979.039738:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788812979.040270:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788812979.040276:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:3.0:1788812979.044725:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788812979.061783:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788812979.062083:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788812979.062090:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788812979.063085:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788812979.063093:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788812979.063615:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788812979.063782:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788812979.063787:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788812979.064223:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788812979.064235:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788812979.064682:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788812979.064808:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788812979.064813:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788812979.065325:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788812979.065330:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788812979.065831:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788812979.066096:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788812979.066101:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788812979.066454:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788812979.066459:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788812979.078065:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788812979.078261:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788812979.078267:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788812979.079406:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788812979.079416:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788812979.080061:0:6470:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788812979.080067:0:6470:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788812979.080761:0:6470:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788812979.080787:0:6470:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788812979.080792:0:6470:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788812979.080878:0:6470:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788812979.080907:0:6470:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.113@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788812979.080912:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788812979.080913:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788812979.080915:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788812979.080916:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788812979.080917:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788812979.080918:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788812979.080919:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788812979.080920:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788812979.080921:0:6470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788812979.080923:0:6470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788812979.080924:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788812979.080926:0:6470:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788812979.080928:0:6470:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788812979.081040:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788812979.081042:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788812979.081043:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788812979.081044:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788812979.081045:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788812979.081046:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788812979.081047:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788812979.081048:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788812979.081049:0:6470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788812979.081050:0:6470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788812979.081051:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788812979.081057:0:6470:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788812979.081086:0:6470:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788812979.081099:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008583b577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313179392:0@lo:253: 00000100:00100000:0.0:1788812979.081160:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812979.081242:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000571f11d0 going to sleep for 11 seconds 00000100:00100000:1.0:1788812979.081306:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313179392 00000100:00100000:1.0:1788812979.081312:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313179392 00000100:00100000:1.0:1788812979.081381:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788812979.081389:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000651cfb12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+5:6470:x1875706313179392:12345-0@lo:253: 20000000:01000000:1.0:1788812979.081430:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788812979.081432:0:6488:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788812979.081706:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788812979.081756:0:6488:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788812979.082023:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788812979.083005:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788812979.083175:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788812979.083178:0:6488:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788812979.083189:0:6488:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788812979.083192:0:6488:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788812979.083202:0:6488:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788812979.083307:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788812979.083468:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788812979.083480:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788812979.083495:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788812979.083508:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788812979.083519:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788812979.083559:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788812979.083566:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788812979.083577:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788812979.083581:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788812979.083591:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788812979.083595:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788812979.083604:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788812979.083626:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788812979.083651:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788812979.083656:0:6488:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788812979.083663:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788812979.083753:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788812979.083762:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788812979.083774:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788812979.083786:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788812979.083797:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788812979.083805:0:6488:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788812979.083824:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788812979.083830:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788812979.083840:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788812979.083852:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788812979.083863:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788812979.083870:0:6488:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788812979.083894:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788812979.083900:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788812979.083911:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788812979.083923:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788812979.087826:0:6488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788812979.087849:0:6488:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788812979.087856:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788812979.088320:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788812979.088500:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788812979.088521:0:6488:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.113@tcp for mdt 20000000:01000000:1.0:1788812979.088524:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.113@tcp (null) (null) (null) 00000040:00080000:1.0:1788812979.088536:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788812979.088540:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788812979.088550:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788812979.088555:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.113@tcp (null) (null) 00000040:00080000:1.0:1788812979.088575:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788812979.088582:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788812979.088592:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788812979.088604:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788812979.088626:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788812979.088629:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788812979.088633:0:6488:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788812979.088697:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788812979.088700:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788812979.088969:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788812979.089123:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788812979.089139:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788812979.089151:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788812979.089158:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788812979.089160:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788812979.089351:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788812979.089453:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788812979.089468:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788812979.089479:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1788812979.089487:0:6488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788812979.089489:0:6488:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788812979.089493:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788812979.089495:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788812979.089503:0:6488:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788812979.089508:0:6488:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788812979.089701:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788812979.089779:0:6488:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788812979.094152:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788812979.094178:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788812979.094190:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788812979.094206:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788812979.094224:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002e86d555/0xf32533d6ff70252c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.094239:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002e86d555/0xf32533d6ff70252c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.094250:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002e86d555/0xf32533d6ff70252c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.094256:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002e86d555/0xf32533d6ff70252c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.094261:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002e86d555/0xf32533d6ff70252c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.094278:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002e86d555/0xf32533d6ff70252c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.094284:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002e86d555 already unused, calling callback (000000004f082eb1) 00010000:00010000:0.0:1788812979.094287:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002e86d555/0xf32533d6ff70252c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.094294:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002e86d555/0xf32533d6ff70252c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.094305:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002e86d555/0xf32533d6ff70252c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.094312:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002e86d555/0xf32533d6ff70252c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.094318:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002e86d555/0xf32533d6ff70252c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788812979.094333:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788812979.102441:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000651cfb12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+5:6470:x1875706313179392:12345-0@lo:253: Request processed in 21045us (21273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812979.102456:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788812979.104870:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008583b577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313179392:0@lo:253: 10000000:01000000:0.0:1788812979.104889:0:6470:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788812979.104892:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788812979.104894:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788812979.104895:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788812979.104896:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788812979.104898:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788812979.104899:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788812979.104900:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788812979.104901:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788812979.104902:0:6470:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788812979.104918:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788812979.104919:0:6470:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788812979.105041:0:6470:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000025dcdd35 from lustre-MDT0000 10000000:01000000:0.0:1788812979.105071:0:6470:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788812979.105074:0:6470:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788812979.105078:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff948a506e4d40 10000000:01000000:0.0:1788812979.105081:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788812979.105088:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff948a506e4d40 from 1 10000000:01000000:0.0:1788812979.105091:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788812979.105125:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 000000002e86d555/0xf32533d6ff702533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.105133:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 000000002e86d555/0xf32533d6ff702533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.105140:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 000000002e86d555/0xf32533d6ff702533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812979.105156:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008583b577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313179520:0@lo:101: 00000100:00100000:0.0:1788812979.105207:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812979.105295:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a5cf4d6f going to sleep for 11 seconds 00000100:00100000:1.0:1788812979.105820:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313179520 00000100:00100000:1.0:1788812979.105828:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313179520 00000100:00100000:1.0:1788812979.105887:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788812979.105896:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000acd9f4fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+5:6470:x1875706313179520:12345-0@lo:101: 00010000:00010000:1.0:1788812979.105910:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788812979.105925:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006f3530a7/0xf32533d6ff70253a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702533 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.105966:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f3530a7/0xf32533d6ff70253a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702533 expref: 6 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.105977:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006f3530a7/0xf32533d6ff70253a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702533 expref: 6 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.105987:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006f3530a7, rc 0) 00000100:00100000:0.0:1788812979.106090:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000acd9f4fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+6:6470:x1875706313179520:12345-0@lo:101: Request processed in 194us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812979.106097:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788812979.106175:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008583b577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313179520:0@lo:101: 00010000:00010000:1.0:1788812979.106188:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 000000002e86d555/0xf32533d6ff702533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70253a expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.106197:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 000000002e86d555/0xf32533d6ff702533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70253a expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812979.106266:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004db0c2a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313179648:0@lo:501: 00000100:00100000:1.0:1788812979.106294:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812979.106324:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d73e078 going to sleep for 11 seconds 00000100:00100000:0.0:1788812979.106366:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313179648 00000100:00100000:0.0:1788812979.106370:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313179648 00000100:00100000:0.0:1788812979.106397:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788812979.106403:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000015af4d5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+6:6470:x1875706313179648:12345-0@lo:501: 00000100:00100000:0.0:1788812979.106468:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000015af4d5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+6:6470:x1875706313179648:12345-0@lo:501: Request processed in 65us (173us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788812979.106474:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788812979.106533:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004db0c2a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313179648:0@lo:501: 10000000:01000000:1.0:1788812979.106557:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788812979.106573:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 000000002e86d555/0xf32533d6ff702533 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70253a expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.106581:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 000000002e86d555/0xf32533d6ff702533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70253a expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788812979.106588:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff948a60186000 10000000:01000000:1.0:1788812979.106591:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788812979.106595:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff948a60186000 10000000:01000000:1.0:1788812979.106597:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788812979.106600:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff948a60186000 from 1 10000000:01000000:1.0:1788812979.106602:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788812979.106615:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 00000000c0c58fee/0xf32533d6ff702541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.106621:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 00000000c0c58fee/0xf32533d6ff702541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.106628:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 00000000c0c58fee/0xf32533d6ff702541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812979.106637:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004db0c2a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313179776:0@lo:101: 00000100:00100000:1.0:1788812979.106659:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812979.106685:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d73e078 going to sleep for 11 seconds 00000100:00100000:0.0:1788812979.106723:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313179776 00000100:00100000:0.0:1788812979.106727:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313179776 00000100:00100000:0.0:1788812979.106755:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788812979.106761:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000019594701 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+6:6470:x1875706313179776:12345-0@lo:101: 00010000:00010000:0.0:1788812979.106768:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788812979.106775:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000051d5de17/0xf32533d6ff702548 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702541 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.106788:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051d5de17/0xf32533d6ff702548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702541 expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.106795:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000051d5de17/0xf32533d6ff702548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702541 expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.106801:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000051d5de17, rc 0) 00000100:00100000:0.0:1788812979.106836:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000019594701 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+7:6470:x1875706313179776:12345-0@lo:101: Request processed in 76us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812979.106842:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788812979.106966:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004db0c2a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313179776:0@lo:101: 00010000:00010000:2.0:1788812979.106976:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 00000000c0c58fee/0xf32533d6ff702541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702548 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812979.106984:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 00000000c0c58fee/0xf32533d6ff702541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702548 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788812979.106994:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788812979.107046:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 00000000c0c58fee/0xf32533d6ff702541 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702548 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812979.107054:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 00000000c0c58fee/0xf32533d6ff702541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702548 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788812979.107075:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788812979.107078:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788812979.107082:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff948a60186000 10000000:01000000:2.0:1788812979.107084:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788812979.107086:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788812979.107088:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788812979.107101:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70254f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812979.107107:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70254f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812979.107114:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70254f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812979.107124:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db67725f pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313179904:0@lo:101: 00000100:00100000:2.0:1788812979.107170:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812979.107196:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a9dbd9eb going to sleep for 11 seconds 00000100:00100000:1.0:1788812979.107275:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313179904 00000100:00100000:1.0:1788812979.107283:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313179904 00000100:00100000:1.0:1788812979.107310:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788812979.107315:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000028831c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+7:6470:x1875706313179904:12345-0@lo:101: 00010000:00010000:1.0:1788812979.107322:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788812979.107328:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b79c582e/0xf32533d6ff702556 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70254f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.107339:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b79c582e/0xf32533d6ff702556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70254f expref: 8 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.107347:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b79c582e/0xf32533d6ff702556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70254f expref: 8 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.107353:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b79c582e, rc 0) 00000100:00100000:1.0:1788812979.107419:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000028831c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+8:6470:x1875706313179904:12345-0@lo:101: Request processed in 104us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812979.107425:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788812979.107467:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db67725f pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313179904:0@lo:101: 00010000:00010000:2.0:1788812979.107475:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70254f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702556 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812979.107482:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70254f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702556 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812979.107567:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db67725f pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313180032:0@lo:501: 00000100:00100000:2.0:1788812979.107588:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812979.107645:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a9dbd9eb going to sleep for 11 seconds 00000100:00100000:1.0:1788812979.107723:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313180032 00000100:00100000:1.0:1788812979.107727:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313180032 00000100:00100000:1.0:1788812979.107784:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788812979.107790:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006f8834a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+8:6470:x1875706313180032:12345-0@lo:501: 00000100:00100000:1.0:1788812979.107880:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006f8834a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+9:6470:x1875706313180032:12345-0@lo:501: Request processed in 91us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812979.107886:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788812979.107967:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db67725f pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313180032:0@lo:501: 00000100:00100000:3.0:1788812979.108005:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf6fd95e pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313180160:0@lo:503: 00000100:00100000:3.0:1788812979.108036:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812979.108050:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b603423 going to sleep for 11 seconds 00000100:00100000:1.0:1788812979.108097:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313180160 00000100:00100000:1.0:1788812979.108101:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313180160 00000100:00100000:1.0:1788812979.108116:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788812979.108121:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000583c8861 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+9:6470:x1875706313180160:12345-0@lo:503: 00000100:00100000:1.0:1788812979.108185:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000583c8861 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+9:6470:x1875706313180160:12345-0@lo:503: Request processed in 64us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812979.108196:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788812979.108255:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf6fd95e pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313180160:0@lo:503: 00000100:00100000:1.0:1788812979.108565:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035dbd858 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:6516:1875706313180288:0@lo:502: 00000100:00100000:1.0:1788812979.108593:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812979.108660:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f94de5c going to sleep for 11 seconds 00000100:00100000:2.0:1788812979.108702:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313180288 00000100:00100000:2.0:1788812979.108706:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313180288 00000100:00100000:2.0:1788812979.108758:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788812979.108764:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000392f115 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+9:6516:x1875706313180288:12345-0@lo:502: 00000100:00100000:2.0:1788812979.108879:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000392f115 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+9:6516:x1875706313180288:12345-0@lo:502: Request processed in 116us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812979.108886:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788812979.109071:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035dbd858 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:6516:1875706313180288:0@lo:502: 00000020:01000000:3.0:1788812979.109091:0:6516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788812979.109102:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788812979.109105:0:6516:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788812979.109109:0:6516:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788812979.109112:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788812979.109131:0:6516:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c86ba4db) 00000020:00000080:3.0:1788812979.109147:0:6516:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788812979.109152:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788812979.109255:0:6516:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788812979.109261:0:6516:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff702564 00000020:00000080:3.0:1788812979.109451:0:6516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788812979.109455:0:6516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788812979.109458:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788812979.109459:0:6516:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788812979.109462:0:6516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788812979.109465:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788812979.109466:0:6516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788812979.109474:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788812979.109479:0:6516:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000000df72884) 00000020:00000080:3.0:1788812979.109487:0:6516:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788812979.109490:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788812979.109492:0:6516:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788812979.109494:0:6516:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788812979.109500:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788812979.109542:0:6516:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000025dcdd35 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788812979.109550:0:6516:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000cdb84ad8) 00000020:00000080:3.0:1788812979.109556:0:6516:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788812979.109614:0:6516:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788812979.109618:0:6516:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff702579 00000020:00000080:3.0:1788812979.109718:0:6516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788812979.109725:0:6516:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788812979.109729:0:6516:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf32533d6ff702580 00080000:01000000:3.0:1788812979.109733:0:6516:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788812979.109736:0:6516:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff702587 00080000:10000000:3.0:1788812979.110285:0:6516:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788812979.110407:0:6516:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788812979.114452:0:6516:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788812979.163178:0:6516:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788812979.163535:0:6516:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788812979.166084:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788812979.166404:0:6516:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788812979.170505:0:6516:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d1acdf5c) 00000020:00000080:2.0:1788812979.170527:0:6516:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788812979.170612:0:6516:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788812979.170619:0:6516:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff702595 00000020:00000080:3.0:1788812979.175225:0:6516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788812979.179088:0:6516:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1788812979.183264:0:6516:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1788812979.187714:0:6516:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1788812979.191642:0:6516:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788812979.197315:0:6516:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788812979.203439:0:6516:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788812979.204875:0:6516:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf32533d6ff70259c 00000020:00000080:3.0:1788812979.205098:0:6516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788812979.205108:0:6516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788812979.205113:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788812979.205114:0:6516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788812979.205116:0:6516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788812979.205119:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788812979.205123:0:6516:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788812979.205125:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788812979.205126:0:6516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788812979.205128:0:6516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788812979.205130:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788812979.205131:0:6516:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788812979.205132:0:6516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788812979.205135:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788812979.205136:0:6516:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788812979.205138:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788812979.205162:0:6516:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788812979.205201:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf6fd95e pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:6516:1875706313180416:0@lo:502: 00000100:00100000:3.0:1788812979.205258:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812979.205307:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313180416 00000100:00100000:2.0:1788812979.205315:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313180416 00000100:00100000:3.0:1788812979.205336:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set 0000000026931492 going to sleep for 11 seconds 00000100:00100000:2.0:1788812979.205534:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788812979.205546:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000ccdc294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+9:6516:x1875706313180416:12345-0@lo:502: 00000100:00100000:2.0:1788812979.205687:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000ccdc294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+9:6516:x1875706313180416:12345-0@lo:502: Request processed in 145us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812979.205695:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788812979.205779:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf6fd95e pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:6516:1875706313180416:0@lo:502: 00000020:01000000:3.0:1788812979.205803:0:6516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788812979.205807:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788812979.205807:0:6516:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788812979.205810:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788812979.206493:0:6470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788812979.206520:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788812979.206536:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70254f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702556 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.206547:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70254f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702556 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788812979.206555:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a60186000 from 1 10000000:01000000:0.0:1788812979.206557:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788812979.206584:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff7025a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.206603:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff7025a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.206621:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff7025a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812979.206642:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092e47a53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313180544:0@lo:101: 00000100:00100000:0.0:1788812979.206685:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812979.208752:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313180544 00000100:00100000:1.0:1788812979.208768:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313180544 00000100:00100000:0.0:1788812979.208789:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da61f8a7 going to sleep for 11 seconds 00000100:00100000:2.0:1788812979.208845:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788812979.208856:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002bb72aaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+9:6470:x1875706313180544:12345-0@lo:101: 00010000:00010000:2.0:1788812979.208873:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788812979.208900:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f5cf116f/0xf32533d6ff7025aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7025a3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812979.208927:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5cf116f/0xf32533d6ff7025aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7025a3 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812979.208967:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f5cf116f/0xf32533d6ff7025aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7025a3 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812979.208976:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f5cf116f, rc 0) 00000100:00100000:2.0:1788812979.209032:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002bb72aaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+10:6470:x1875706313180544:12345-0@lo:101: Request processed in 179us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812979.209039:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788812979.209059:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092e47a53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313180544:0@lo:101: 00010000:00010000:0.0:1788812979.209078:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff7025a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7025aa expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.209088:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff7025a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7025aa expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812979.209843:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092e47a53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313180672:0@lo:256: 00000100:00100000:0.0:1788812979.209888:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812979.209917:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da61f8a7 going to sleep for 11 seconds 00000100:00100000:2.0:1788812979.209952:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313180672 00000100:00100000:2.0:1788812979.209959:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313180672 00000100:00100000:2.0:1788812979.209996:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788812979.210003:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c6036ce3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+10:6470:x1875706313180672:12345-0@lo:256: 20000000:01000000:2.0:1788812979.210017:0:6488:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788812979.210023:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788812979.210096:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c6036ce3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+10:6470:x1875706313180672:12345-0@lo:256: Request processed in 93us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812979.210103:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788812979.210114:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092e47a53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313180672:0@lo:256: 10000000:01000000:0.0:1788812979.210766:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788812979.210822:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff7025a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7025aa expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.210832:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff7025a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7025aa expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788812979.211477:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a60186000 from 1 10000000:01000000:0.0:1788812979.211480:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788812979.211552:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff7025b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.211562:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff7025b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.211572:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff7025b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812979.211591:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092e47a53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313180800:0@lo:101: 00000100:00100000:1.0:1788812979.211783:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812979.211818:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e671c4e5 going to sleep for 11 seconds 00000100:00100000:3.0:1788812979.211836:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313180800 00000100:00100000:3.0:1788812979.211843:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313180800 00000100:00100000:3.0:1788812979.211882:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788812979.211889:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000057c92b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+10:6470:x1875706313180800:12345-0@lo:101: 00010000:00010000:3.0:1788812979.211901:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788812979.211914:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e495769/0xf32533d6ff7025b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7025b1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812979.211956:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e495769/0xf32533d6ff7025b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7025b1 expref: 11 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812979.211966:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e495769/0xf32533d6ff7025b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7025b1 expref: 11 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812979.211983:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e495769, rc 0) 00000100:00100000:3.0:1788812979.212026:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000057c92b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:6470:x1875706313180800:12345-0@lo:101: Request processed in 138us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812979.212033:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788812979.212064:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092e47a53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313180800:0@lo:101: 00010000:00010000:1.0:1788812979.212080:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff7025b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7025b8 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.212088:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff7025b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7025b8 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812979.212140:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079fcfc63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313180928:0@lo:501: 00000100:00100000:1.0:1788812979.212163:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812979.212189:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e671c4e5 going to sleep for 11 seconds 00000100:00100000:2.0:1788812979.212251:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313180928 00000100:00100000:2.0:1788812979.212255:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313180928 00000100:00100000:2.0:1788812979.212319:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788812979.212327:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dbb4c086 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:6470:x1875706313180928:12345-0@lo:501: 00000100:00100000:2.0:1788812979.212474:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dbb4c086 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:6470:x1875706313180928:12345-0@lo:501: Request processed in 148us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812979.212480:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788812979.212510:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079fcfc63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313180928:0@lo:501: 00000100:00100000:3.0:1788812979.212541:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf6fd95e pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313181056:0@lo:503: 00000100:00100000:3.0:1788812979.212586:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812979.212771:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af24f0ce going to sleep for 11 seconds 00000100:00100000:0.0:1788812979.212803:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313181056 00000100:00100000:0.0:1788812979.212807:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313181056 00000100:00100000:0.0:1788812979.212834:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788812979.212840:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e01efceb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:6470:x1875706313181056:12345-0@lo:503: 00000040:00080000:0.0:1788812979.212870:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788812979.212961:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e01efceb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:6470:x1875706313181056:12345-0@lo:503: Request processed in 121us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812979.212967:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788812979.213043:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf6fd95e pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313181056:0@lo:503: 00000040:00080000:3.0:1788812979.213901:0:6520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788812979.217132:0:6470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788812979.217166:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788812979.217185:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff7025b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7025b8 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.217199:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff7025b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7025b8 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788812979.217253:0:6470:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788812979.217256:0:6470:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff948a60186000 10000000:01000000:1.0:1788812979.217259:0:6470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff948a60186000 10000000:01000000:1.0:1788812979.217263:0:6470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788812979.217268:0:6470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a60186000 from 1 10000000:01000000:1.0:1788812979.217271:0:6470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788812979.217302:0:6470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff7025bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.217311:0:6470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff7025bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.217320:0:6470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff7025bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812979.217340:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d0bb523 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313181184:0@lo:101: 00000100:00100000:1.0:1788812979.217401:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812979.217446:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db96317e going to sleep for 11 seconds 00000100:00100000:3.0:1788812979.217650:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313181184 00000100:00100000:3.0:1788812979.217658:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313181184 00000100:00100000:3.0:1788812979.217718:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788812979.217727:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000000d3fea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:6470:x1875706313181184:12345-0@lo:101: 00010000:00010000:3.0:1788812979.217739:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788812979.217749:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ea76762c/0xf32533d6ff7025c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7025bf expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812979.217771:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea76762c/0xf32533d6ff7025c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7025bf expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812979.217781:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ea76762c/0xf32533d6ff7025c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7025bf expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812979.217790:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ea76762c, rc 0) 00000100:00100000:3.0:1788812979.217831:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000000d3fea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6470:x1875706313181184:12345-0@lo:101: Request processed in 106us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812979.217850:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788812979.217865:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d0bb523 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313181184:0@lo:101: 00010000:00010000:1.0:1788812979.217880:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff7025bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7025c6 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.217899:0:6470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff7025bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7025c6 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812979.218081:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d0bb523 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313181312:0@lo:501: 00000100:00100000:1.0:1788812979.218107:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812979.218134:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db96317e going to sleep for 11 seconds 00000100:00100000:3.0:1788812979.218395:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313181312 00000100:00100000:3.0:1788812979.218399:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313181312 00000100:00100000:3.0:1788812979.218420:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788812979.218424:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e828cdf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6470:x1875706313181312:12345-0@lo:501: 00000100:00100000:3.0:1788812979.218507:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e828cdf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6470:x1875706313181312:12345-0@lo:501: Request processed in 83us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812979.218512:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788812979.218542:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d0bb523 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313181312:0@lo:501: 00000100:00100000:1.0:1788812979.218568:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d0bb523 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313181440:0@lo:503: 00000100:00100000:1.0:1788812979.218605:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812979.218636:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db96317e going to sleep for 11 seconds 00000100:00100000:3.0:1788812979.218718:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313181440 00000100:00100000:3.0:1788812979.218721:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313181440 00000100:00100000:3.0:1788812979.218747:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788812979.218750:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b3ffa530 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6470:x1875706313181440:12345-0@lo:503: 00000100:00100000:3.0:1788812979.218803:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b3ffa530 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6470:x1875706313181440:12345-0@lo:503: Request processed in 52us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812979.218807:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788812979.220511:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d0bb523 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313181440:0@lo:503: 00000100:00100000:2.0:1788812979.221061:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033956b78 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:6521:1875706313181568:0@lo:502: 00000100:00100000:2.0:1788812979.221110:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812979.221139:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000353545cd going to sleep for 11 seconds 00000100:00100000:3.0:1788812979.221172:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313181568 00000100:00100000:3.0:1788812979.221177:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313181568 00000100:00100000:3.0:1788812979.221212:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788812979.221218:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000450df4b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6521:x1875706313181568:12345-0@lo:502: 00000100:00100000:3.0:1788812979.221305:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000450df4b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6521:x1875706313181568:12345-0@lo:502: Request processed in 88us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812979.221310:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788812979.224209:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033956b78 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:6521:1875706313181568:0@lo:502: 00000020:01000004:0.0:1788812979.224291:0:6521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788812979.224308:0:6521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c0ea53b5) 00000020:00000080:0.0:1788812979.224326:0:6521:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788812979.224425:0:6521:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000025dcdd35 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788812979.224429:0:6521:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000025dcdd35 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788812979.224431:0:6521:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000025dcdd35 4 00010000:00080000:0.0:1788812979.224459:0:6521:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000021d80427@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.113@tcp at head 00010000:00010000:0.0:1788812979.226012:0:6521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788812979.226186:0:6521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788812979.226213:0:6521:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788812979.226222:0:6521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf32533d6ff7025d4 00000100:00080000:0.0:1788812979.226230:0:6521:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788812979.226237:0:6521:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000021d80427 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788812979.226266:0:6521:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000080c65014 x1875706313181696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788812979.226295:0:6521:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788812979.226389:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080c65014 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313181696:0@lo:38: 00000100:00100000:3.0:1788812979.226476:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812979.226744:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313181696 00000100:00100000:0.0:1788812979.226751:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313181696 00000100:00100000:0.0:1788812979.226818:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788812979.226824:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bf6fd95e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1875706313181696:12345-0@lo:38: 00000100:00100000:0.0:1788812979.226884:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bf6fd95e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1875706313181696:12345-0@lo:38: Request processed in 60us (409us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788812979.226891:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788812979.226997:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788812979.227005:0:3624:0:(import.c:65:import_set_state_nolock()) 0000000021d80427 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788812979.227015:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788812979.227018:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080c65014 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313181696:0@lo:38: 00000100:00100000:0.0:1788812979.231903:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f0ee7531 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:6521:1875706313181824:0@lo:502: 00000100:00100000:0.0:1788812979.231986:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812979.232028:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313181824 00000100:00100000:2.0:1788812979.232036:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313181824 00000100:00100000:2.0:1788812979.232087:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788812979.232097:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c3f27995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6521:x1875706313181824:12345-0@lo:502: 00000100:00100000:2.0:1788812979.232212:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c3f27995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6521:x1875706313181824:12345-0@lo:502: Request processed in 117us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812979.232221:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788812979.232275:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 0000000001d1010d going to sleep for 11 seconds 00000100:00100000:2.0:1788812979.232296:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f0ee7531 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:6521:1875706313181824:0@lo:502: 00000040:00080000:2.0:1788812979.232322:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788812979.232383:0:6470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788812979.232409:0:6470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788812979.232426:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff7025bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7025c6 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.232438:0:6470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff7025bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7025c6 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788812979.232481:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788812979.232483:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788812979.232485:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788812979.232486:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788812979.232487:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788812979.232489:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788812979.232490:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788812979.232491:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788812979.232492:0:6470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788812979.232497:0:6470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788812979.232498:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788812979.232500:0:6470:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788812979.232503:0:6470:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788812979.232505:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788812979.232506:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788812979.232507:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788812979.232508:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788812979.232509:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788812979.232510:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788812979.232511:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788812979.232512:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788812979.232513:0:6470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788812979.232514:0:6470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788812979.232515:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788812979.232516:0:6470:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788812979.232528:0:6470:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788812979.232534:0:6470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d0bb523 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313181952:0@lo:253: 00000100:00100000:1.0:1788812979.232561:0:6470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812979.232577:0:6470:0:(client.c:2716:ptlrpc_set_wait()) set 000000008413d2ca going to sleep for 11 seconds 00000100:00100000:2.0:1788812979.232597:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313181952 00000100:00100000:2.0:1788812979.232603:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313181952 00000100:00100000:2.0:1788812979.232776:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788812979.232784:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fa4990b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6470:x1875706313181952:12345-0@lo:253: 20000000:01000000:2.0:1788812979.232802:0:6486:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788812979.232814:0:6486:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788812979.238352:0:6486:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788812979.238366:0:6486:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788812979.238382:0:6510:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788812979.238387:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788812979.238409:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003035cccc/0xf32533d6ff7025db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.238428:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f5cf116f/0xf32533d6ff7025aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7025a3 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.238436:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003035cccc/0xf32533d6ff7025db lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.238476:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f5cf116f/0xf32533d6ff7025aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7025a3 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.238490:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f5cf116f/0xf32533d6ff7025aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7025a3 expref: 12 pid: 6488 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812979.238517:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d5c01e0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6510:1875706313182080:0@lo:104: 00000100:00100000:1.0:1788812979.238576:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812979.238619:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f001c8c7 going to sleep for 11 seconds 00000100:00100000:2.0:1788812979.238805:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313182080 00000100:00100000:2.0:1788812979.238814:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313182080 00000100:00100000:2.0:1788812979.238860:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788812979.238870:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c71158f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6510:x1875706313182080:12345-0@lo:104: 00010000:00010000:2.0:1788812979.238881:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff7025a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7025aa expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812979.238962:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788812979.238966:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c71158f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6510:x1875706313182080:12345-0@lo:104: Request processed in 100us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812979.238971:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d5c01e0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6510:1875706313182080:0@lo:104: 00000100:00100000:2.0:1788812979.238974:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788812979.238993:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003035cccc/0xf32533d6ff7025db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.239032:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788812979.239036:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff7025a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7025aa expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.239041:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fd7ccc00 already unused, calling callback (00000000fec9925f) 10000000:00010000:0.0:1788812979.239043:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff7025a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7025aa expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.239048:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff7025a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7025aa expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788812979.239052:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff7025a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7025aa expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788812979.239055:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788812979.239080:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff7025a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7025aa expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.239084:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788812979.239150:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b504df3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313182208:0@lo:103: 00000100:00100000:1.0:1788812979.239170:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788812979.239220:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff7025a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7025aa expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.239238:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff7025a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7025aa expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812979.239255:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788812979.239257:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788812979.239259:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788812979.239308:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313182208 00000100:00100000:1.0:1788812979.239313:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313182208 00000100:00100000:3.0:1788812979.239318:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fa4990b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:6470:x1875706313181952:12345-0@lo:253: Request processed in 6534us (6755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812979.239328:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1788812979.239333:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f5cf116f/0xf32533d6ff7025aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7025a3 expref: 13 pid: 6488 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812979.239390:0:6470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d0bb523 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:6470:1875706313181952:0@lo:253: 10000000:01000000:0.0:1788812979.239398:0:6470:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788812979.239400:0:6470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788812979.239401:0:6470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788812979.239402:0:6470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788812979.239403:0:6470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788812979.239404:0:6470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788812979.239405:0:6470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788812979.239406:0:6470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788812979.239407:0:6470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788812979.239408:0:6470:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788812979.239409:0:6470:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788812979.239410:0:6470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788812979.239411:0:6470:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788812979.239420:0:6470:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788812979.239484:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788812979.239490:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002d5c01e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:3626:x1875706313182208:12345-0@lo:103: 00000100:00100000:2.0:1788812979.239494:0:6479:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788812979.239499:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788812979.239505:0:6479:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788812979.239505:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f5cf116f/0xf32533d6ff7025aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7025a3 expref: 12 pid: 6488 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.239514:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f5cf116f/0xf32533d6ff7025aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7025a3 expref: 12 pid: 6488 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.239522:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f5cf116f/0xf32533d6ff7025aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7025a3 expref: 12 pid: 6488 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.239531:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003035cccc/0xf32533d6ff7025db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.239540:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003035cccc/0xf32533d6ff7025db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788812979.239549:0:6478:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001162967s 00010000:00010000:1.0:1788812979.239551:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003035cccc/0xf32533d6ff7025db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.239555:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003035cccc/0xf32533d6ff7025db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.239559:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003035cccc/0xf32533d6ff7025db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.239562:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003035cccc/0xf32533d6ff7025db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.239565:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003035cccc already unused, calling callback (000000004f082eb1) 00010000:00010000:1.0:1788812979.239567:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003035cccc/0xf32533d6ff7025db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.239571:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003035cccc/0xf32533d6ff7025db lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.239581:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003035cccc/0xf32533d6ff7025db lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.239587:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788812979.239609:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002d5c01e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:3626:x1875706313182208:12345-0@lo:103: Request processed in 121us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812979.239613:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788812979.239650:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b504df3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313182208:0@lo:103: 00010000:00010000:1.0:1788812979.239677:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003035cccc/0xf32533d6ff7025db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.239683:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003035cccc/0xf32533d6ff7025db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812979.239688:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003035cccc/0xf32533d6ff7025db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1788812979.242102:0:6470:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1788812979.242219:0:6470:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788812979.242379:0:6470:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1788812979.242483:0:6470:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788812979.242606:0:6470:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1788812979.242836:0:6470:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788812979.244115:0:6470:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1788812979.244284:0:6470:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788812979.244440:0:6470:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1788812979.244568:0:6470:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788812979.245217:0:6470:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1788812979.245395:0:6470:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1788812979.247217:0:6470:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788812979.252605:0:6470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788812979.252611:0:6527:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788812979.252617:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788812979.252891:0:6528:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788812979.254078:0:6470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788812979.254202:0:6470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788812979.254659:0:6470:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788812979.254697:0:6470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788812979.254812:0:6470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788812979.256102:0:6470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788812979.256736:0:6470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788812979.256781:0:6470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788812979.257033:0:6470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788812979.257227:0:6470:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:3.0:1788812979.257729:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:2.0:1788812979.258799:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788812979.259076:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788812979.259249:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788812979.259381:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788812979.259516:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788812979.260796:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788812979.261020:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788812979.261157:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788812979.261301:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788812979.261423:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788812979.261565:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788812979.261719:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788812979.261851:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788812979.262028:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788812979.262196:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788812979.262318:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788812979.262606:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000040:00080000:3.0:1788812979.264076:0:6528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788812979.264143:0:6528:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788812979.264147:0:6528:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1788812979.264846:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788812979.265023:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788812979.265151:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788812979.265268:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788812979.265405:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788812979.265537:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788812979.266531:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788812979.266860:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788812979.267139:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788812979.267282:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788812979.267420:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788812979.267520:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788812979.268076:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788812979.268166:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788812979.268252:0:6470:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788812979.268388:0:6470:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788812979.270765:0:6470:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788812979.270802:0:6470:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb265019b3988 00100000:10000000:2.0:1788812979.270810:0:6470:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788812979.271249:0:6470:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788812979.271266:0:6470:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788812979.271285:0:6470:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788812979.271304:0:6470:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788812979.272110:0:6470:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788812979.273616:0:6470:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788812980.068707:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788812981.092179:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788812981.773413:0:6772:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788812982.116107:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788812982.284604:0:6824:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788812982.284921:0:6824:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788812983.140306:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788812984.164277:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788812984.284049:0:6925:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788812984.284200:0:6925:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1788812984.676371:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788812984.676381:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788812984.676384:0:37:0:(import.c:65:import_set_state_nolock()) 0000000021d80427 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788812984.676402:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000021d80427 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788812984.676426:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d598ff11 x1875706313182464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788812984.676459:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d598ff11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313182464:0@lo:38: 00000100:00100000:1.0:1788812984.676538:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812984.676562:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071affc89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313182336:0@lo:400: 00000100:00100000:0.0:1788812984.676611:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812984.676664:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313182464 00000100:00100000:0.0:1788812984.676671:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313182464 00000100:00100000:0.0:1788812984.676733:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788812984.676741:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003da0ab52 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313182464:12345-0@lo:38: 00000100:00100000:2.0:1788812984.676968:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313182336 00000100:00100000:2.0:1788812984.676980:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313182336 00010000:00080000:1.0:1788812984.677158:0:6496:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 137 last 0 00000020:00000080:1.0:1788812984.677190:0:6496:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf32533d6ff7025e2 00000100:00100000:0.0:1788812984.677210:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788812984.677218:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f19c1aab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:3627:x1875706313182336:12345-0@lo:400: 00000004:00100000:1.0:1788812984.677258:0:6496:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788812984.677275:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f19c1aab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:3627:x1875706313182336:12345-0@lo:400: Request processed in 56us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812984.677290:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788812984.677396:0:6496:0:(import.c:65:import_set_state_nolock()) 0000000015797273 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788812984.677444:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003da0ab52 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875706313182464:12345-0@lo:38: Request processed in 704us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812984.677456:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788812984.677501:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d598ff11 x1875706313182464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788812994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788812984.677514:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788812984.677519:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788812984.677523:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788812984.677525:0:3624:0:(import.c:65:import_set_state_nolock()) 0000000021d80427 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788812984.677529:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d598ff11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313182464:0@lo:38: 00000100:00100000:3.0:1788812984.678703:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071affc89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313182336:0@lo:400: 00010000:00010000:3.0:1788812985.188239:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788812985.700128:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788812985.700139:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a60186000 from 3 10000000:01000000:1.0:1788812985.700147:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788812985.700219:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 000000003035cccc/0xf32533d6ff7025e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812985.700236:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 000000003035cccc/0xf32533d6ff7025e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812985.700250:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 000000003035cccc/0xf32533d6ff7025e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812985.700281:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d598ff11 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313182592:0@lo:101: 00000100:00100000:1.0:1788812985.700399:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812985.700491:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000835b7435 going to sleep for 11 seconds 00000100:00100000:2.0:1788812985.700532:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313182592 00000100:00100000:2.0:1788812985.700546:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313182592 00000100:00100000:2.0:1788812985.700595:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788812985.700615:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002136a1e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:6492:x1875706313182592:12345-0@lo:101: 00010000:00010000:2.0:1788812985.700632:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788812985.700650:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4a925f8/0xf32533d6ff7025f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7025e9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812985.700674:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4a925f8/0xf32533d6ff7025f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7025e9 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812985.700683:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4a925f8/0xf32533d6ff7025f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7025e9 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812985.700691:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4a925f8, rc 0) 00000100:00100000:2.0:1788812985.700769:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002136a1e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6492:x1875706313182592:12345-0@lo:101: Request processed in 166us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812985.700776:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788812985.700847:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d598ff11 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313182592:0@lo:101: 00010000:00010000:1.0:1788812985.700867:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 000000003035cccc/0xf32533d6ff7025e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7025f0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812985.700902:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 000000003035cccc/0xf32533d6ff7025e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7025f0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812985.701010:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d598ff11 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313182720:0@lo:256: 00000100:00100000:1.0:1788812985.701054:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812985.701083:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000835b7435 going to sleep for 11 seconds 00000100:00100000:3.0:1788812985.701115:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313182720 00000100:00100000:3.0:1788812985.701123:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313182720 00000100:00100000:3.0:1788812985.701160:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788812985.701186:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000facded45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6492:x1875706313182720:12345-0@lo:256: 20000000:01000000:3.0:1788812985.701202:0:6487:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788812985.701217:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788812985.701221:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788812985.701322:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000facded45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6492:x1875706313182720:12345-0@lo:256: Request processed in 140us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812985.701330:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788812985.701354:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d598ff11 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313182720:0@lo:256: 10000000:01000000:1.0:1788812985.701420:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788812985.701427:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 000000003035cccc/0xf32533d6ff7025e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7025f0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812985.701436:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 000000003035cccc/0xf32533d6ff7025e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7025f0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812986.213737:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788812987.236105:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788812988.260373:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788812989.216923:0:7423:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788812989.216927:0:7423:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788812989.216928:0:7423:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788812989.217294:0:7423:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000000ef234f2 00000020:01000004:2.0:1788812989.217369:0:7423:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788812989.217381:0:7423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788812989.217393:0:7423:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000005bdd20be) 00000020:00000080:2.0:1788812989.217407:0:7423:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788812989.252831:0:7423:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788812989.252919:0:7423:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788812989.274530:0:7423:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788812989.275738:0:7423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788812989.275755:0:7423:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788812989.275766:0:7423:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff7025fe 00000020:01000004:2.0:1788812989.275773:0:7423:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788812989.275792:0:7423:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.113@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788812989.275795:0:7423:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788812989.275800:0:7423:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788812989.275833:0:7423:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788812989.275841:0:7423:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.113@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00010000:00010000:1.0:1788812989.285184:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788812989.292862:0:7423:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788812989.292903:0:7423:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.113@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1788812989.292907:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788812989.292909:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788812989.292910:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788812989.292912:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788812989.292913:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788812989.292914:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788812989.292915:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788812989.292917:0:7423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788812989.292918:0:7423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788812989.292920:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788812989.292921:0:7423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788812989.292925:0:7423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1788812989.292927:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788812989.292928:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788812989.292929:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788812989.292968:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788812989.292969:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788812989.292970:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788812989.292971:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788812989.292972:0:7423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788812989.292973:0:7423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788812989.292974:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788812989.292975:0:7423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788812989.293003:0:7423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788812989.293021:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca1769aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313182848:0@lo:253: 00000100:00100000:3.0:1788812989.293098:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812989.293156:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc4772d8 going to sleep for 11 seconds 00000100:00100000:2.0:1788812989.293288:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313182848 00000100:00100000:2.0:1788812989.293297:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313182848 00000100:00100000:2.0:1788812989.293352:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788812989.293362:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006e7eda4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:7423:x1875706313182848:12345-0@lo:253: 20000000:01000000:2.0:1788812989.293392:0:6486:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788812989.293395:0:6486:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1788812989.293399:0:6486:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1788812989.293401:0:6486:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1788812989.293430:0:6486:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1788812989.293589:0:6486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788812989.293722:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788812989.293735:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788812989.293752:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788812989.293767:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788812989.293781:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788812989.293832:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1788812989.293841:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1788812989.293854:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1788812989.293859:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1788812989.293872:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1788812989.293877:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1788812989.293889:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788812989.293904:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788812989.294648:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1788812989.294662:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.113@tcp (null) (null) (null) 00000040:00080000:0.0:1788812989.294676:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1788812989.294681:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788812989.294694:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1788812989.294700:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.113@tcp (null) (null) 00000040:00080000:0.0:1788812989.294711:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1788812989.294716:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788812989.294728:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788812989.294744:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788812989.294754:0:6486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788812989.294906:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1788812989.294925:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1788812989.294969:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788812989.294990:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788812989.295009:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1788812989.295014:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1788812989.295025:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788812989.295044:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788812989.295049:0:6486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1788812989.295071:0:6486:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788812989.295078:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788812989.296026:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788812989.296156:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788812989.296177:0:6486:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.113@tcp for mdt 20000000:01000000:3.0:1788812989.296179:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.113@tcp (null) (null) (null) 00000040:00080000:3.0:1788812989.296191:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788812989.296206:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788812989.296222:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788812989.296230:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.113@tcp (null) (null) 00000040:00080000:3.0:1788812989.296248:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788812989.296257:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1788812989.296267:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1788812989.296287:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1788812989.296324:0:6486:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1788812989.296330:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1788812989.296563:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1788812989.296685:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788812989.296694:0:6486:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.113@tcp for mdt 20000000:01000000:0.0:1788812989.296695:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.113@tcp (null) (null) (null) 00000040:00080000:0.0:1788812989.296702:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788812989.296705:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788812989.296712:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788812989.296714:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.113@tcp (null) (null) 00000040:00080000:0.0:1788812989.296720:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788812989.296724:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1788812989.296729:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788812989.296736:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1788812989.296748:0:6486:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788812989.296750:0:6486:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788812989.296754:0:6486:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788812989.296787:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788812989.296789:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788812989.297064:0:7431:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788812989.297087:0:7431:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788812989.297103:0:7431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788812989.297181:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1788812989.297266:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1788812989.297331:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1788812989.297343:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788812989.297344:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788812989.297619:0:7432:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788812989.297634:0:7432:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788812989.297642:0:7432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1788812989.297750:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788812989.297762:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788812989.297771:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1788812989.297776:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788812989.297777:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788812989.298137:0:7433:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788812989.298159:0:7433:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788812989.298174:0:7433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788812989.298696:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788812989.298709:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788812989.298721:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788812989.298729:0:6486:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788812989.298731:0:6486:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788812989.298735:0:6486:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788812989.298740:0:6486:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788812989.298966:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1788812989.299027:0:6486:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788812989.303827:0:6486:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788812989.303854:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000abc12f4b/0xf32533d6ff702605 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.303870:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006f3530a7/0xf32533d6ff70253a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702533 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.303875:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b79c582e/0xf32533d6ff702556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70254f expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.303878:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ea76762c/0xf32533d6ff7025c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7025bf expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.303882:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000abc12f4b/0xf32533d6ff702605 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.303915:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ea76762c/0xf32533d6ff7025c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7025bf expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.303926:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ea76762c/0xf32533d6ff7025c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7025bf expref: 12 pid: 6486 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812989.304039:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000314e950e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313182976:0@lo:104: 00000100:00100000:0.0:1788812989.304102:0:6486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788812989.304176:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b79c582e/0xf32533d6ff702556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff70254f expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.304196:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b79c582e/0xf32533d6ff702556 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff70254f expref: 12 pid: 6486 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812989.304204:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000313dfe3e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313183104:0@lo:104: 00000100:00100000:0.0:1788812989.304225:0:6486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788812989.304370:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006f3530a7/0xf32533d6ff70253a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702533 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.304376:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006f3530a7/0xf32533d6ff70253a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702533 expref: 12 pid: 6487 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812989.304381:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000382da97d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313183232:0@lo:104: 00000100:00100000:0.0:1788812989.304393:0:6486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812989.304452:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313182976 00000100:00100000:3.0:1788812989.304467:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313182976 00000100:00100000:3.0:1788812989.304511:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313183104 00000100:00100000:3.0:1788812989.304514:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313183104 00000100:00100000:3.0:1788812989.304526:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788812989.304547:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000032f5f2d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6486:x1875706313182976:12345-0@lo:104: 00010000:00010000:3.0:1788812989.304558:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff7025bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7025c6 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.304620:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788812989.304624:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000032f5f2d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6486:x1875706313182976:12345-0@lo:104: Request processed in 93us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812989.304629:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788812989.304648:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788812989.304650:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788812989.304658:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000052ec1b0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6486:x1875706313183104:12345-0@lo:104: 00010000:00010000:2.0:1788812989.304658:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff7025bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7025c6 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.304668:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70254f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702556 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.304672:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000107f7a94 already unused, calling callback (00000000fec9925f) 10000000:00010000:2.0:1788812989.304677:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff7025bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7025c6 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.304686:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff7025bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7025c6 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788812989.304693:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff7025bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7025c6 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.304694:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788812989.304701:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000052ec1b0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6486:x1875706313183104:12345-0@lo:104: Request processed in 43us (475us total) trans 0 rc 0/0 10000000:01000000:2.0:1788812989.304710:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788812989.304711:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788812989.304747:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff7025bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7025c6 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.304754:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788812989.304781:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff7025bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7025c6 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.304788:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff7025bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7025c6 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.304801:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788812989.304803:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70254f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702556 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.304838:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f80fd231 already unused, calling callback (00000000fec9925f) 10000000:00010000:2.0:1788812989.304841:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70254f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702556 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.304847:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70254f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702556 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788812989.304852:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70254f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702556 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788812989.304858:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788812989.304871:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70254f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702556 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.304877:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788812989.304891:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70254f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702556 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.304897:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70254f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702556 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.304906:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788812989.304907:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788812989.304909:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788812989.304956:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f15ec70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313183360:0@lo:103: 00000100:00100000:3.0:1788812989.304976:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812989.305004:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7a90dda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313183488:0@lo:103: 00000100:00100000:3.0:1788812989.305017:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812989.305038:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313183360 00000100:00100000:3.0:1788812989.305042:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313183360 00010000:00010000:3.0:1788812989.305060:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ea76762c/0xf32533d6ff7025c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7025bf expref: 13 pid: 6486 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812989.305068:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313183488 00000100:00100000:2.0:1788812989.305075:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313183488 00010000:00010000:2.0:1788812989.305094:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b79c582e/0xf32533d6ff702556 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70254f expref: 14 pid: 6486 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788812989.305095:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788812989.305104:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006a0e1395 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:3628:x1875706313183360:12345-0@lo:103: 00010000:00010000:3.0:1788812989.305113:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788812989.305117:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ea76762c/0xf32533d6ff7025c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7025bf expref: 14 pid: 6486 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812989.305124:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788812989.305125:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ea76762c/0xf32533d6ff7025c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7025bf expref: 14 pid: 6486 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.305136:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788812989.305140:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000117a45b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:3625:x1875706313183488:12345-0@lo:103: 00010000:00010000:2.0:1788812989.305151:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788812989.305156:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b79c582e/0xf32533d6ff702556 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70254f expref: 14 pid: 6486 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788812989.305162:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006a0e1395 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:3628:x1875706313183360:12345-0@lo:103: Request processed in 58us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812989.305174:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788812989.305178:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b79c582e/0xf32533d6ff702556 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff70254f expref: 14 pid: 6486 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.305190:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788812989.305209:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f15ec70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313183360:0@lo:103: 00000100:00100000:2.0:1788812989.305228:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000117a45b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:3625:x1875706313183488:12345-0@lo:103: Request processed in 90us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812989.305236:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788812989.305240:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7a90dda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313183488:0@lo:103: 00000100:00100000:1.0:1788812989.305375:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313183232 00000100:00100000:0.0:1788812989.305375:0:6486:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b983b5fa going to sleep for 11 seconds 00000100:00100000:1.0:1788812989.305382:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313183232 00010000:00010000:0.0:1788812989.305386:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ea76762c/0xf32533d6ff7025c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7025bf expref: 12 pid: 6486 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812989.305394:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000314e950e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313182976:0@lo:104: 00010000:00010000:0.0:1788812989.305402:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b79c582e/0xf32533d6ff702556 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff70254f expref: 11 pid: 6486 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812989.305406:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000313dfe3e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313183104:0@lo:104: 00000100:00100000:3.0:1788812989.305440:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788812989.305449:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e036510a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6486:x1875706313183232:12345-0@lo:104: 00010000:00010000:1.0:1788812989.305453:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788812989.305457:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: 000000002e86d555/0xf32533d6ff702533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70253a expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.305538:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788812989.305543:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e036510a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6486:x1875706313183232:12345-0@lo:104: Request processed in 98us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812989.305549:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788812989.305558:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788812989.305563:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: 000000002e86d555/0xf32533d6ff702533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70253a expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.305582:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002e86d555 already unused, calling callback (00000000fec9925f) 10000000:00010000:2.0:1788812989.305585:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: 000000002e86d555/0xf32533d6ff702533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff70253a expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.305591:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: 000000002e86d555/0xf32533d6ff702533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff70253a expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788812989.305596:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: 000000002e86d555/0xf32533d6ff702533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff70253a expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788812989.305601:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788812989.305635:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000382da97d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313183232:0@lo:104: 00010000:00010000:0.0:1788812989.305648:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000abc12f4b/0xf32533d6ff702605 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.305681:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: 000000002e86d555/0xf32533d6ff702533 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70253a expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.305689:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788812989.305728:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074722b51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313183616:0@lo:103: 00000100:00100000:3.0:1788812989.305751:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812989.305790:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313183616 00000100:00100000:0.0:1788812989.305796:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313183616 00010000:00010000:0.0:1788812989.305807:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006f3530a7/0xf32533d6ff70253a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702533 expref: 11 pid: 6487 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812989.305820:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788812989.305823:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000090e11a8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:3626:x1875706313183616:12345-0@lo:103: 00010000:00010000:0.0:1788812989.305828:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788812989.305830:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006f3530a7/0xf32533d6ff70253a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702533 expref: 11 pid: 6487 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.305835:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006f3530a7/0xf32533d6ff70253a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702533 expref: 11 pid: 6487 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.305843:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f3530a7/0xf32533d6ff70253a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702533 expref: 11 pid: 6487 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.305851:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000abc12f4b/0xf32533d6ff702605 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.305856:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000abc12f4b/0xf32533d6ff702605 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.305864:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000abc12f4b/0xf32533d6ff702605 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.305867:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000abc12f4b/0xf32533d6ff702605 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.305871:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000abc12f4b/0xf32533d6ff702605 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.305874:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000abc12f4b/0xf32533d6ff702605 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.305881:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000abc12f4b already unused, calling callback (000000004f082eb1) 00010000:00010000:0.0:1788812989.305883:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000abc12f4b/0xf32533d6ff702605 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.305887:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000abc12f4b/0xf32533d6ff702605 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.305901:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000abc12f4b/0xf32533d6ff702605 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.305907:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788812989.305960:0:6486:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000abc12f4b/0xf32533d6ff702605 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.305967:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000abc12f4b/0xf32533d6ff702605 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.305976:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000abc12f4b/0xf32533d6ff702605 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788812989.305988:0:6486:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788812989.307336:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006e7eda4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+10:7423:x1875706313182848:12345-0@lo:253: Request processed in 13971us (14233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812989.307345:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788812989.307355:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: 000000002e86d555/0xf32533d6ff702533 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70253a expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.307365:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: 000000002e86d555/0xf32533d6ff702533 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70253a expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.307383:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788812989.307385:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788812989.307387:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788812989.308017:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca1769aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313182848:0@lo:253: 10000000:01000000:2.0:1788812989.308034:0:7423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788812989.308037:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788812989.308039:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788812989.308041:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788812989.308043:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788812989.308044:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788812989.308046:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788812989.308047:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788812989.308049:0:7423:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788812989.308051:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788812989.308052:0:7423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788812989.308083:0:7423:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000ef234f2 from lustre-MDT0001 10000000:01000000:2.0:1788812989.308111:0:7423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788812989.308115:0:7423:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788812989.308121:0:7423:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff948a506e4d40 local copy 10000000:01000000:2.0:1788812989.308125:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788812989.308161:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 000000007012b60b/0xf32533d6ff70260c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.308170:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.113@tcp lock: 000000007012b60b/0xf32533d6ff70260c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.308180:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 000000007012b60b/0xf32533d6ff70260c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812989.308206:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a47693b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313183744:0@lo:101: 00000100:00100000:2.0:1788812989.308250:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812989.308285:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3dbba4f going to sleep for 11 seconds 00000100:00100000:0.0:1788812989.309380:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000090e11a8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+9:3626:x1875706313183616:12345-0@lo:103: Request processed in 3552us (3624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812989.309391:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788812989.309420:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074722b51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313183616:0@lo:103: 00000100:00100000:3.0:1788812989.309447:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313183744 00000100:00100000:3.0:1788812989.309453:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313183744 00000100:00100000:3.0:1788812989.309502:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788812989.309510:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000094490e3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+9:7423:x1875706313183744:12345-0@lo:101: 00010000:00010000:3.0:1788812989.309521:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788812989.309637:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002911ae49/0xf32533d6ff702613 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70260c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.309661:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002911ae49/0xf32533d6ff702613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70260c expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.309669:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002911ae49/0xf32533d6ff702613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70260c expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.309674:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002911ae49, rc 0) 00000100:00100000:3.0:1788812989.309713:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000094490e3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+10:7423:x1875706313183744:12345-0@lo:101: Request processed in 205us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812989.309717:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788812989.310086:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a47693b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313183744:0@lo:101: 00010000:00010000:2.0:1788812989.310101:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 000000007012b60b/0xf32533d6ff70260c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf32533d6ff702613 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.310111:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 000000007012b60b/0xf32533d6ff70260c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf32533d6ff702613 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812989.310204:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a47693b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313183872:0@lo:501: 00000100:00100000:2.0:1788812989.310236:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812989.310267:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313183872 00000100:00100000:2.0:1788812989.310270:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3dbba4f going to sleep for 11 seconds 00000100:00100000:1.0:1788812989.310324:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313183872 00000100:00100000:1.0:1788812989.310348:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788812989.310354:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005dbf5525 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+10:7423:x1875706313183872:12345-0@lo:501: 00000100:00100000:1.0:1788812989.310419:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005dbf5525 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+10:7423:x1875706313183872:12345-0@lo:501: Request processed in 65us (183us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788812989.310424:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788812989.311897:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a47693b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313183872:0@lo:501: 10000000:01000000:2.0:1788812989.311920:0:7423:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788812989.311970:0:7423:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788812989.311977:0:7423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 000000007012b60b/0xf32533d6ff70260c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf32533d6ff702613 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.311987:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 000000007012b60b/0xf32533d6ff70260c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf32533d6ff702613 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.311994:0:7423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: 000000007012b60b/0xf32533d6ff70260c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf32533d6ff702613 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.312021:0:7423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788812989.312080:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff948a61047800 10000000:01000000:2.0:1788812989.312087:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788812989.312094:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff948a506e4d40 10000000:01000000:2.0:1788812989.312096:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788812989.312100:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff948a506e4d40 from 1 10000000:01000000:2.0:1788812989.312103:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788812989.312135:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 000000006fba7a58/0xf32533d6ff70261a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.312143:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 000000006fba7a58/0xf32533d6ff70261a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.312153:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 000000006fba7a58/0xf32533d6ff70261a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812989.312170:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a47693b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313184000:0@lo:101: 00010000:00010000:1.0:1788812989.312177:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788812989.312184:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: 000000007012b60b/0xf32533d6ff70260c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf32533d6ff702613 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.312193:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007012b60b already unused, calling callback (00000000fec9925f) 10000000:00010000:1.0:1788812989.312196:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: 000000007012b60b/0xf32533d6ff70260c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf32533d6ff702613 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.312203:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: 000000007012b60b/0xf32533d6ff70260c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf32533d6ff702613 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788812989.312209:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: 000000007012b60b/0xf32533d6ff70260c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf32533d6ff702613 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812989.312221:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1788812989.312229:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788812989.312249:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: 000000007012b60b/0xf32533d6ff70260c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf32533d6ff702613 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.312255:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788812989.312267:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c3365f3c going to sleep for 11 seconds 00010000:00010000:1.0:1788812989.312301:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: 000000007012b60b/0xf32533d6ff70260c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf32533d6ff702613 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.312308:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: 000000007012b60b/0xf32533d6ff70260c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf32533d6ff702613 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.312320:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788812989.312322:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788812989.312323:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788812989.312362:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313184000 00000100:00100000:3.0:1788812989.312368:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313184000 00000100:00100000:3.0:1788812989.312415:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788812989.312423:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e938553 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+10:7423:x1875706313184000:12345-0@lo:101: 00010000:00010000:3.0:1788812989.312434:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788812989.312446:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001dbda6cc/0xf32533d6ff702621 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70261a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.312475:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001dbda6cc/0xf32533d6ff702621 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70261a expref: 11 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.312483:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001dbda6cc/0xf32533d6ff702621 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70261a expref: 11 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.312491:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001dbda6cc, rc 0) 00000100:00100000:3.0:1788812989.312523:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e938553 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:7423:x1875706313184000:12345-0@lo:101: Request processed in 102us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812989.312530:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788812989.312680:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d598ff11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313184128:0@lo:103: 00000100:00100000:0.0:1788812989.312712:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812989.312870:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313184128 00000100:00100000:3.0:1788812989.312875:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313184128 00000100:00100000:3.0:1788812989.312969:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788812989.312976:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000382da97d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:3627:x1875706313184128:12345-0@lo:103: 00010000:00010000:3.0:1788812989.312987:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788812989.312999:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002911ae49/0xf32533d6ff702613 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff70260c expref: 11 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.313011:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788812989.313045:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000382da97d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+10:3627:x1875706313184128:12345-0@lo:103: Request processed in 70us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812989.313051:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788812989.313823:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d598ff11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313184128:0@lo:103: 00000100:00100000:2.0:1788812989.314399:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a47693b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313184000:0@lo:101: 00010000:00010000:2.0:1788812989.314422:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 000000006fba7a58/0xf32533d6ff70261a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702621 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.314433:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 000000006fba7a58/0xf32533d6ff70261a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702621 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788812989.314452:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788812989.314464:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 000000006fba7a58/0xf32533d6ff70261a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702621 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.314472:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 000000006fba7a58/0xf32533d6ff70261a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702621 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788812989.314496:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff948a61047800 10000000:01000000:2.0:1788812989.314501:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788812989.314506:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff948a61047800 from 1 10000000:01000000:2.0:1788812989.314509:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788812989.314532:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 00000000b2498049/0xf32533d6ff702628 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.314539:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 00000000b2498049/0xf32533d6ff702628 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.314547:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 00000000b2498049/0xf32533d6ff702628 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812989.314562:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a47693b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313184256:0@lo:101: 00000100:00100000:2.0:1788812989.314610:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812989.314642:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313184256 00000100:00100000:2.0:1788812989.314644:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c3365f3c going to sleep for 11 seconds 00000100:00100000:1.0:1788812989.314648:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313184256 00000100:00100000:1.0:1788812989.314707:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788812989.314713:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000042afc2db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+10:7423:x1875706313184256:12345-0@lo:101: 00010000:00010000:1.0:1788812989.314722:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788812989.314731:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000120a65ae/0xf32533d6ff70262f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702628 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.314743:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000120a65ae/0xf32533d6ff70262f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702628 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.314748:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000120a65ae/0xf32533d6ff70262f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702628 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.314765:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000120a65ae, rc 0) 00000100:00100000:1.0:1788812989.314807:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000042afc2db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:7423:x1875706313184256:12345-0@lo:101: Request processed in 94us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812989.314813:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788812989.314879:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a47693b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313184256:0@lo:101: 00010000:00010000:2.0:1788812989.314889:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 00000000b2498049/0xf32533d6ff702628 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70262f expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.314896:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 00000000b2498049/0xf32533d6ff702628 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70262f expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788812989.314906:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788812989.314915:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 00000000b2498049/0xf32533d6ff702628 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70262f expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.314922:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 00000000b2498049/0xf32533d6ff702628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70262f expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788812989.314984:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788812989.314988:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788812989.314995:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff948a61047800 10000000:01000000:3.0:1788812989.315030:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788812989.315036:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788812989.315039:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788812989.315057:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 000000006fe79f37/0xf32533d6ff702636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.315073:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 000000006fe79f37/0xf32533d6ff702636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.315081:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 000000006fe79f37/0xf32533d6ff702636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788812989.315093:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000293d5d05 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313184384:0@lo:101: 00000100:00100000:3.0:1788812989.315134:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812989.315164:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 0000000091970682 going to sleep for 11 seconds 00000100:00100000:0.0:1788812989.315204:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313184384 00000100:00100000:0.0:1788812989.315209:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313184384 00000100:00100000:0.0:1788812989.315242:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788812989.315247:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000190506c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:7423:x1875706313184384:12345-0@lo:101: 00010000:00010000:0.0:1788812989.315253:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788812989.315259:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a2092114/0xf32533d6ff70263d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702636 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.315277:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a2092114/0xf32533d6ff70263d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702636 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.315282:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a2092114/0xf32533d6ff70263d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702636 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.315291:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a2092114, rc 0) 00000100:00100000:0.0:1788812989.315318:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000190506c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:7423:x1875706313184384:12345-0@lo:101: Request processed in 71us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812989.315321:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788812989.315897:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000293d5d05 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313184384:0@lo:101: 00010000:00010000:2.0:1788812989.315911:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 000000006fe79f37/0xf32533d6ff702636 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70263d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.315918:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 000000006fe79f37/0xf32533d6ff702636 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70263d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812989.316033:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a47693b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313184512:0@lo:501: 00000100:00100000:2.0:1788812989.316063:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812989.316088:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c3365f3c going to sleep for 11 seconds 00000100:00100000:1.0:1788812989.316095:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313184512 00000100:00100000:1.0:1788812989.316099:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313184512 00000100:00100000:1.0:1788812989.316148:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788812989.316153:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e200e6ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:7423:x1875706313184512:12345-0@lo:501: 00000100:00100000:1.0:1788812989.316252:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e200e6ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:7423:x1875706313184512:12345-0@lo:501: Request processed in 100us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812989.316257:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788812989.316326:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a47693b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313184512:0@lo:501: 00000100:00100000:2.0:1788812989.316355:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a47693b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313184640:0@lo:503: 00000100:00100000:2.0:1788812989.316397:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812989.316414:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c3365f3c going to sleep for 11 seconds 00000100:00100000:3.0:1788812989.316426:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313184640 00000100:00100000:3.0:1788812989.316432:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313184640 00000100:00100000:3.0:1788812989.316491:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788812989.316499:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bae2e112 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:7423:x1875706313184640:12345-0@lo:503: 00000100:00100000:3.0:1788812989.316601:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bae2e112 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:7423:x1875706313184640:12345-0@lo:503: Request processed in 103us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812989.316608:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788812989.316796:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a47693b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313184640:0@lo:503: 00000040:00080000:1.0:1788812989.317411:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788812989.317479:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d598ff11 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313184768:0@lo:502: 00000100:00100000:1.0:1788812989.317520:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812989.317560:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c8df6107 going to sleep for 11 seconds 00000100:00100000:2.0:1788812989.317615:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313184768 00000100:00100000:2.0:1788812989.317622:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313184768 00000100:00100000:2.0:1788812989.317654:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788812989.317660:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003a4dba3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:7423:x1875706313184768:12345-0@lo:502: 00000100:00100000:2.0:1788812989.317756:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003a4dba3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:7423:x1875706313184768:12345-0@lo:502: Request processed in 96us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812989.317765:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788812989.317781:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d598ff11 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313184768:0@lo:502: 00000040:00080000:1.0:1788812989.317995:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788812989.318014:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788812989.318021:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788812989.318028:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788812989.318038:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788812989.318051:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788812989.318063:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788812989.318075:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788812989.318089:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788812989.318101:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788812989.318109:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788812989.318123:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788812989.318130:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788812989.318137:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788812989.318144:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788812989.318151:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788812989.318158:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788812989.318165:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788812989.318171:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788812989.318178:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788812989.318186:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788812989.318214:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788812989.318229:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788812989.318249:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d598ff11 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313184896:0@lo:502: 00000100:00100000:1.0:1788812989.318386:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812989.318428:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c8df6107 going to sleep for 11 seconds 00000100:00100000:3.0:1788812989.318459:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313184896 00000100:00100000:3.0:1788812989.318464:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313184896 00000100:00100000:3.0:1788812989.318500:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788812989.318507:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000ef95cac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:7423:x1875706313184896:12345-0@lo:502: 00000100:00100000:3.0:1788812989.318678:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000ef95cac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:7423:x1875706313184896:12345-0@lo:502: Request processed in 172us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812989.318685:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788812989.318781:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d598ff11 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313184896:0@lo:502: 00000040:00080000:1.0:1788812989.318811:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788812989.318817:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1788812989.319211:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788812989.319221:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788812989.319224:0:7435:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788812989.319228:0:7435:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788812989.319236:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788812989.319249:0:7435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000543078d6) 00000020:00000080:3.0:1788812989.319263:0:7435:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1788812989.319322:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788812989.319381:0:7435:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788812989.319386:0:7435:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff70264b 00000020:00000080:3.0:1788812989.319662:0:7435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788812989.319665:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788812989.319669:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788812989.319670:0:7435:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788812989.319673:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788812989.319676:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788812989.319677:0:7435:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788812989.319681:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788812989.319696:0:7435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000819fdc42) 00000020:00000080:3.0:1788812989.319708:0:7435:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788812989.319713:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788812989.319714:0:7435:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788812989.319717:0:7435:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788812989.319723:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788812989.319775:0:7435:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000ef234f2 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788812989.319788:0:7435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000030a2f466) 00000020:00000080:3.0:1788812989.319796:0:7435:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788812989.319853:0:7435:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788812989.319858:0:7435:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff702660 00000020:00000080:3.0:1788812989.320013:0:7435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788812989.320019:0:7435:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788812989.320022:0:7435:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf32533d6ff702667 00080000:01000000:3.0:1788812989.320026:0:7435:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788812989.320029:0:7435:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff70266e 00080000:10000000:3.0:1788812989.320474:0:7435:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788812989.320690:0:7435:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1788812989.382532:0:7435:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1788812989.382822:0:7435:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1788812989.385648:0:7435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788812989.386023:0:7435:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788812989.396725:0:7435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788812989.396742:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788812989.396748:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788812989.396750:0:7435:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788812989.396753:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788812989.396758:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788812989.396759:0:7435:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788812989.396763:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788812989.396767:0:7435:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:00000080:3.0:1788812989.396794:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788812989.396807:0:7435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000b6c3d398) 00000020:00000080:3.0:1788812989.396830:0:7435:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788812989.396834:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788812989.396910:0:7435:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788812989.396916:0:7435:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788812989.396922:0:7435:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff70267c 00010000:00080000:3.0:1788812989.396984:0:7435:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ed8dd8e7@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.113@tcp at head 00010000:00010000:3.0:1788812989.398635:0:7435:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1788812989.399224:0:7435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788812989.399390:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788812989.399434:0:7435:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788812989.399465:0:7435:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff702683 00000100:00080000:2.0:1788812989.399476:0:7435:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788812989.399486:0:7435:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000ed8dd8e7 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788812989.399524:0:7435:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002a47693b x1875706313185024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788812989.399555:0:7435:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788812989.399622:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788812989.399627:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788812989.399629:0:7435:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788812989.399632:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788812989.399635:0:7435:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788812989.399636:0:7435:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788812989.399638:0:7435:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788812989.399639:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788812989.399642:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788812989.399643:0:7435:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788812989.399646:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788812989.399650:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788812989.399651:0:7435:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788812989.399655:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788812989.399688:0:7435:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788812989.399703:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788812989.399707:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788812989.399708:0:7435:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788812989.399711:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788812989.399713:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788812989.399714:0:7435:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788812989.399717:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788812989.399724:0:7435:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788812989.399755:0:7435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788812989.399759:0:7435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788812989.399760:0:7435:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788812989.399763:0:7435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1788812989.400162:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a47693b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313185024:0@lo:38: 00000100:00100000:1.0:1788812989.400252:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788812989.400338:0:7423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1788812989.400369:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788812989.400384:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 000000006fe79f37/0xf32533d6ff702636 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70263d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.400396:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 000000006fe79f37/0xf32533d6ff702636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70263d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788812989.400404:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a61047800 from 1 10000000:01000000:1.0:1788812989.400407:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788812989.400440:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff70268a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.400448:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff70268a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.400459:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff70268a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812989.400474:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fe583de pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313185152:0@lo:101: 00000100:00100000:1.0:1788812989.400505:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812989.400521:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 0000000090cf5331 going to sleep for 11 seconds 00000100:00100000:1.0:1788812989.400563:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313185152 00000100:00100000:1.0:1788812989.400581:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313185152 00000100:00100000:3.0:1788812989.400798:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039d2ffb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313185280:0@lo:400: 00000100:00100000:3.0:1788812989.400829:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812989.400855:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313185280 00000100:00100000:0.0:1788812989.400859:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313185280 00000100:00100000:0.0:1788812989.400891:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788812989.400899:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c73c1d44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313185280:12345-0@lo:400: 00000100:00100000:0.0:1788812989.400976:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c73c1d44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313185280:12345-0@lo:400: Request processed in 79us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812989.400984:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788812989.401024:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313185024 00000100:00100000:2.0:1788812989.401029:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313185024 00000100:00100000:2.0:1788812989.401047:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788812989.401051:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d598ff11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1875706313185024:12345-0@lo:38: 00010000:00080000:2.0:1788812989.401069:0:6499:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:2.0:1788812989.401098:0:6499:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff702691 00000004:00100000:2.0:1788812989.401112:0:6499:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788812989.401118:0:6499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:3.0:1788812989.401248:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000039d2ffb6 x1875706313185280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788812989.401261:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039d2ffb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313185280:0@lo:400: 00000100:00100000:0.0:1788812989.401737:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788812989.401746:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c2f1e0e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:7423:x1875706313185152:12345-0@lo:101: 00010000:00010000:0.0:1788812989.401756:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788812989.401768:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702698 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70268a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.401789:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70268a expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.401798:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70268a expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.401805:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000222ef3b9, rc 0) 00000100:00100000:0.0:1788812989.401849:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c2f1e0e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:7423:x1875706313185152:12345-0@lo:101: Request processed in 105us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812989.401860:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788812989.402407:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fe583de pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313185152:0@lo:101: 00010000:00010000:2.0:1788812989.402422:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff70268a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702698 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.402431:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff70268a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702698 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812989.403099:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f46cc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313185408:0@lo:256: 00000100:00100000:2.0:1788812989.403148:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812989.403185:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ea95aeac going to sleep for 11 seconds 00000100:00100000:0.0:1788812989.403298:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313185408 00000100:00100000:0.0:1788812989.403304:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313185408 00000100:00100000:0.0:1788812989.403352:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788812989.403359:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000064ccf9d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:7423:x1875706313185408:12345-0@lo:256: 20000000:01000000:0.0:1788812989.403373:0:6487:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788812989.403388:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788812989.403391:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788812989.403474:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000064ccf9d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:7423:x1875706313185408:12345-0@lo:256: Request processed in 116us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812989.403482:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788812989.406792:0:6499:0:(import.c:65:import_set_state_nolock()) 000000009566e08d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788812989.406920:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f46cc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313185408:0@lo:256: 00000100:00100000:1.0:1788812989.406980:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d598ff11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1875706313185024:12345-0@lo:38: Request processed in 5924us (6724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812989.407005:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 10000000:01000000:2.0:1788812989.407467:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788812989.407485:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff70268a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702698 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.407501:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff70268a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702698 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788812989.407506:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a61047800 from 1 10000000:01000000:2.0:1788812989.407508:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788812989.407537:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70269f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.407543:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70269f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.407551:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70269f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812989.407568:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f46cc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313185536:0@lo:101: 00000100:00100000:2.0:1788812989.407620:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812989.407649:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ea95aeac going to sleep for 11 seconds 00000100:00100000:0.0:1788812989.412067:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788812989.412086:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788812989.412095:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788812989.412102:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788812989.412105:0:3624:0:(import.c:65:import_set_state_nolock()) 00000000ed8dd8e7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788812989.412129:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a47693b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313185024:0@lo:38: 00000100:00100000:0.0:1788812989.412187:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313185536 00000100:00100000:0.0:1788812989.412194:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313185536 00000100:00100000:0.0:1788812989.412242:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788812989.412250:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004c9b5060 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:7423:x1875706313185536:12345-0@lo:101: 00010000:00010000:0.0:1788812989.412263:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788812989.412280:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa540725/0xf32533d6ff7026a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70269f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.412307:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa540725/0xf32533d6ff7026a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70269f expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.412336:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa540725/0xf32533d6ff7026a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70269f expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.412345:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa540725, rc 0) 00000100:00100000:0.0:1788812989.412422:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004c9b5060 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:7423:x1875706313185536:12345-0@lo:101: Request processed in 173us (4802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812989.412429:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788812989.412459:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f46cc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313185536:0@lo:101: 00010000:00010000:3.0:1788812989.412475:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70269f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7026a6 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.412484:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70269f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7026a6 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812989.412643:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c71b5df7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313185664:0@lo:41: 00000100:00100000:3.0:1788812989.412724:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039d2ffb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313185792:0@lo:501: 00000100:00100000:0.0:1788812989.412735:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812989.412749:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812989.412779:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb6260b3 going to sleep for 11 seconds 00000100:00100000:1.0:1788812989.413010:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313185792 00000100:00100000:1.0:1788812989.413016:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313185792 00000100:00100000:1.0:1788812989.413055:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788812989.413062:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009cdca6ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:7423:x1875706313185792:12345-0@lo:501: 00000100:00100000:1.0:1788812989.413166:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009cdca6ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:7423:x1875706313185792:12345-0@lo:501: Request processed in 105us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812989.413175:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788812989.413209:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039d2ffb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313185792:0@lo:501: 00000100:00100000:0.0:1788812989.413237:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000314e950e pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313185920:0@lo:503: 00000100:00100000:0.0:1788812989.413271:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812989.413291:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 000000005cac15a2 going to sleep for 11 seconds 00000100:00100000:1.0:1788812989.413427:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313185920 00000100:00100000:1.0:1788812989.413431:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313185920 00000100:00100000:1.0:1788812989.413485:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788812989.413490:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000071e2e05f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:7423:x1875706313185920:12345-0@lo:503: 00000100:00100000:2.0:1788812989.413504:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313185664 00000100:00100000:2.0:1788812989.413510:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313185664 00000040:00080000:1.0:1788812989.413523:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788812989.413564:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000071e2e05f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:7423:x1875706313185920:12345-0@lo:503: Request processed in 74us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812989.413568:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788812989.413598:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788812989.413607:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000313dfe3e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3625:x1875706313185664:12345-0@lo:41: 00000004:00000024:2.0:1788812989.413634:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788812989.413686:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000313dfe3e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3625:x1875706313185664:12345-0@lo:41: Request processed in 82us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812989.413692:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788812989.415676:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000314e950e pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313185920:0@lo:503: 00000040:00080000:0.0:1788812989.415982:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788812989.416033:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1788812989.416112:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788812989.416154:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c71b5df7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313185664:0@lo:41: 00000040:00080000:2.0:1788812989.418532:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1788812989.418759:0:7423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788812989.418789:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788812989.418811:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70269f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7026a6 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.418824:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70269f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7026a6 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788812989.418891:0:7423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788812989.418894:0:7423:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff948a61047800 10000000:01000000:0.0:1788812989.418897:0:7423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff948a61047800 10000000:01000000:0.0:1788812989.418901:0:7423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788812989.418907:0:7423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a61047800 from 1 10000000:01000000:0.0:1788812989.418909:0:7423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788812989.418966:0:7423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 000000003109aa10/0xf32533d6ff7026ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.418976:0:7423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 000000003109aa10/0xf32533d6ff7026ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.418987:0:7423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 000000003109aa10/0xf32533d6ff7026ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812989.419132:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000314e950e pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313186048:0@lo:101: 00000100:00100000:2.0:1788812989.419204:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812989.419242:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 000000008f9b3844 going to sleep for 11 seconds 00000100:00100000:3.0:1788812989.419689:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313186048 00000100:00100000:3.0:1788812989.419697:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313186048 00000100:00100000:3.0:1788812989.419751:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788812989.419759:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b6a8c520 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:7423:x1875706313186048:12345-0@lo:101: 00010000:00010000:3.0:1788812989.419774:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788812989.419786:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002911ae49/0xf32533d6ff7026b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7026ad expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.419810:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002911ae49/0xf32533d6ff7026b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7026ad expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.419820:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002911ae49/0xf32533d6ff7026b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7026ad expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812989.419827:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002911ae49, rc 0) 00000100:00100000:3.0:1788812989.419879:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b6a8c520 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:7423:x1875706313186048:12345-0@lo:101: Request processed in 121us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812989.419885:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788812989.420098:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000314e950e pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313186048:0@lo:101: 00010000:00010000:2.0:1788812989.420113:0:7423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 000000003109aa10/0xf32533d6ff7026ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7026b4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.420122:0:7423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 000000003109aa10/0xf32533d6ff7026ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7026b4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812989.420239:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2e4518b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313186176:0@lo:501: 00000100:00100000:2.0:1788812989.420265:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812989.420286:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 000000008f9b3844 going to sleep for 11 seconds 00000100:00100000:0.0:1788812989.420812:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313186176 00000100:00100000:0.0:1788812989.420818:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313186176 00000100:00100000:0.0:1788812989.420856:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788812989.420864:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aec631ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:7423:x1875706313186176:12345-0@lo:501: 00000100:00100000:0.0:1788812989.420991:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aec631ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:7423:x1875706313186176:12345-0@lo:501: Request processed in 128us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812989.420998:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788812989.421123:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2e4518b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313186176:0@lo:501: 00000100:00100000:2.0:1788812989.421155:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2e4518b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313186304:0@lo:503: 00000100:00100000:2.0:1788812989.421193:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812989.421287:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 000000008f9b3844 going to sleep for 11 seconds 00000100:00100000:3.0:1788812989.421674:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313186304 00000100:00100000:3.0:1788812989.421680:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313186304 00000100:00100000:3.0:1788812989.421717:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788812989.421724:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000048e53909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:7423:x1875706313186304:12345-0@lo:503: 00000100:00100000:3.0:1788812989.421825:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000048e53909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:7423:x1875706313186304:12345-0@lo:503: Request processed in 102us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812989.421854:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788812989.422013:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2e4518b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313186304:0@lo:503: 00000040:00080000:2.0:1788812989.422319:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788812989.422391:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2e4518b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313186432:0@lo:502: 00000100:00100000:2.0:1788812989.422424:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812989.422452:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 000000008f9b3844 going to sleep for 11 seconds 00000100:00100000:1.0:1788812989.422468:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313186432 00000100:00100000:1.0:1788812989.422473:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313186432 00000100:00100000:1.0:1788812989.422499:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788812989.422503:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000066e56506 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:7423:x1875706313186432:12345-0@lo:502: 00000100:00100000:1.0:1788812989.422582:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000066e56506 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:7423:x1875706313186432:12345-0@lo:502: Request processed in 67us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812989.422587:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788812989.422777:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2e4518b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313186432:0@lo:502: 00000040:00080000:2.0:1788812989.423060:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788812989.423083:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788812989.423096:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788812989.423108:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788812989.423140:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788812989.423155:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788812989.423167:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788812989.423179:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788812989.423191:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788812989.423203:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788812989.423215:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788812989.423228:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788812989.423240:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788812989.423253:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788812989.423264:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788812989.423342:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788812989.423354:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788812989.423365:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788812989.423375:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788812989.423386:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788812989.423407:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788812989.423421:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788812989.423432:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788812989.423443:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788812989.423454:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788812989.423465:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788812989.423476:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788812989.423487:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1788812989.423508:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2e4518b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313186560:0@lo:502: 00000100:00100000:2.0:1788812989.423676:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812989.423741:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 000000008f9b3844 going to sleep for 11 seconds 00000100:00100000:3.0:1788812989.423778:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313186560 00000100:00100000:3.0:1788812989.423783:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313186560 00000100:00100000:3.0:1788812989.423823:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788812989.423830:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000019c3430b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:7423:x1875706313186560:12345-0@lo:502: 00000100:00100000:3.0:1788812989.424263:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000019c3430b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:7423:x1875706313186560:12345-0@lo:502: Request processed in 433us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812989.424280:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788812989.424392:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2e4518b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313186560:0@lo:502: 00000040:00080000:2.0:1788812989.424438:0:7423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788812989.424447:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788812989.425019:0:7441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788812989.425034:0:7441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000007112359f) 00000020:00000080:0.0:1788812989.425055:0:7441:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788812989.425131:0:7441:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000ef234f2 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788812989.425135:0:7441:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000ef234f2 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788812989.425137:0:7441:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000ef234f2 3 00010000:00080000:0.0:1788812989.425182:0:7441:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d3f98c2d@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788812989.429309:0:7441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1788812989.429522:0:7441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788812989.429609:0:7441:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788812989.429621:0:7441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf32533d6ff7026c2 00000100:00080000:1.0:1788812989.429631:0:7441:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788812989.429642:0:7441:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000d3f98c2d using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788812989.429677:0:7441:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004380f93e x1875706313186688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788812989.429702:0:7441:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788812989.429799:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004380f93e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875706313186688:0@lo:38: 00000100:00100000:0.0:1788812989.429871:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812989.430508:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313186688 00000100:00100000:1.0:1788812989.430517:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313186688 00000100:00100000:1.0:1788812989.430554:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788812989.430560:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060b0463b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313186688:12345-0@lo:38: 00010000:00080000:1.0:1788812989.430597:0:6496:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:1.0:1788812989.430627:0:6496:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf32533d6ff7026c9 00000004:00100000:1.0:1788812989.430640:0:6496:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788812989.430673:0:6496:0:(import.c:65:import_set_state_nolock()) 0000000082b86eda : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788812989.430729:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060b0463b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875706313186688:12345-0@lo:38: Request processed in 167us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812989.430736:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788812989.430818:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004380f93e x1875706313186688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788812999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788812989.430830:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788812989.430839:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788812989.430846:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788812989.430850:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788812989.430852:0:3624:0:(import.c:65:import_set_state_nolock()) 00000000d3f98c2d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788812989.430857:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004380f93e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875706313186688:0@lo:38: 00000040:00080000:1.0:1788812989.431497:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:0.0:1788812989.431676:0:7442:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:2.0:1788812989.431683:0:7423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788812989.431730:0:7423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788812989.431755:0:7423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 000000003109aa10/0xf32533d6ff7026ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7026b4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812989.431766:0:7423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 000000003109aa10/0xf32533d6ff7026ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7026b4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788812989.431818:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788812989.431820:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788812989.431822:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788812989.431823:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788812989.431824:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788812989.431825:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788812989.431826:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788812989.431828:0:7423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788812989.431828:0:7423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788812989.431830:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788812989.431831:0:7423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788812989.431834:0:7423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1788812989.431836:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788812989.431838:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788812989.431839:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788812989.431840:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788812989.431840:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788812989.431841:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788812989.431842:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788812989.431843:0:7423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788812989.431844:0:7423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788812989.431845:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788812989.431846:0:7423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788812989.431863:0:7423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788812989.431876:0:7423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2e4518b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313186816:0@lo:253: 00000100:00100000:2.0:1788812989.431919:0:7423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812989.431980:0:7423:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000166546 going to sleep for 11 seconds 00000100:00100000:0.0:1788812989.431983:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313186816 00000100:00100000:0.0:1788812989.432059:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313186816 00000100:00100000:0.0:1788812989.432094:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788812989.432101:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb2970c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:7423:x1875706313186816:12345-0@lo:253: 20000000:01000000:0.0:1788812989.432121:0:6486:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788812989.432135:0:6486:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788812989.434238:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788812989.434367:0:6486:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788812989.434382:0:6486:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788812989.434402:0:6510:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788812989.434409:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788812989.434429:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006f3530a7/0xf32533d6ff7026d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.434447:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e4a925f8/0xf32533d6ff7025f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7025e9 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.434456:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70268a expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.434463:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006f3530a7/0xf32533d6ff7026d0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.434497:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff70268a expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.434509:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702698 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff70268a expref: 15 pid: 6488 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812989.434521:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4914d95 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6510:1875706313186944:0@lo:104: 00000100:00100000:1.0:1788812989.434589:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788812989.434624:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e4a925f8/0xf32533d6ff7025f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7025e9 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.434632:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e4a925f8/0xf32533d6ff7025f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7025e9 expref: 15 pid: 6486 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812989.434652:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c82ae14d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6510:1875706313187072:0@lo:104: 00000100:00100000:1.0:1788812989.434675:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812989.434695:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9a6af22 going to sleep for 11 seconds 00000100:00100000:1.0:1788812989.434716:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313186944 00000100:00100000:1.0:1788812989.434722:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313186944 00000100:00100000:0.0:1788812989.434732:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313187072 00000100:00100000:0.0:1788812989.434739:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313187072 00000100:00100000:1.0:1788812989.434756:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788812989.434765:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001d68e24a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6510:x1875706313186944:12345-0@lo:104: 00010000:00010000:1.0:1788812989.434776:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff70268a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702698 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.434822:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788812989.434827:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001d68e24a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6510:x1875706313186944:12345-0@lo:104: Request processed in 64us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812989.436899:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb2970c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:7423:x1875706313186816:12345-0@lo:253: Request processed in 4792us (4973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812989.436913:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788812989.437000:0:7423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2e4518b pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:7423:1875706313186816:0@lo:253: 10000000:01000000:3.0:1788812989.437014:0:7423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788812989.437018:0:7423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788812989.437019:0:7423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788812989.437021:0:7423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788812989.437022:0:7423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788812989.437024:0:7423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788812989.437025:0:7423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788812989.437027:0:7423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788812989.437028:0:7423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788812989.437029:0:7423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788812989.437031:0:7423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788812989.437032:0:7423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788812989.437045:0:7423:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788812989.437690:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788812989.437712:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788812989.437722:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000012a5ab52 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6510:x1875706313187072:12345-0@lo:104: 00010000:00010000:1.0:1788812989.437816:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: 000000003035cccc/0xf32533d6ff7025e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7025f0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.437878:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788812989.437884:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000012a5ab52 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6510:x1875706313187072:12345-0@lo:104: Request processed in 165us (3208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812989.437891:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788812989.437912:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788812989.437918:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff70268a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702698 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.437957:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000107f7a94 already unused, calling callback (00000000fec9925f) 10000000:00010000:1.0:1788812989.437960:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff70268a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702698 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.437968:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff70268a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702698 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788812989.437975:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff70268a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702698 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788812989.437980:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788812989.438024:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff70268a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702698 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.438031:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788812989.438047:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff70268a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702698 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.438053:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: 00000000107f7a94/0xf32533d6ff70268a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702698 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.438064:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788812989.438066:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: 000000003035cccc/0xf32533d6ff7025e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7025f0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.438072:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003035cccc already unused, calling callback (00000000fec9925f) 10000000:00010000:1.0:1788812989.438074:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: 000000003035cccc/0xf32533d6ff7025e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7025f0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.438089:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: 000000003035cccc/0xf32533d6ff7025e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7025f0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788812989.438095:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: 000000003035cccc/0xf32533d6ff7025e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7025f0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788812989.438100:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788812989.438126:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: 000000003035cccc/0xf32533d6ff7025e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7025f0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812989.438132:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788812989.438151:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: 000000003035cccc/0xf32533d6ff7025e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7025f0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812989.438151:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788812989.438160:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: 000000003035cccc/0xf32533d6ff7025e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7025f0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812989.438168:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000377debdc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313187200:0@lo:103: 00010000:00010000:1.0:1788812989.438174:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788812989.438176:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788812989.438178:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788812989.438185:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788812989.438208:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812989.438212:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c756f14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313187328:0@lo:103: 00000100:00100000:1.0:1788812989.438250:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812989.438298:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4914d95 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6510:1875706313186944:0@lo:104: 00000100:00100000:1.0:1788812989.438308:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c82ae14d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6510:1875706313187072:0@lo:104: 00010000:00010000:1.0:1788812989.438326:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006f3530a7/0xf32533d6ff7026d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812989.441414:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313187200 00000100:00100000:0.0:1788812989.441435:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313187200 00010000:00010000:0.0:1788812989.441486:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702698 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70268a expref: 15 pid: 6488 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812989.441677:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313187328 00000100:00100000:0.0:1788812989.441682:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313187328 00010000:00010000:0.0:1788812989.441696:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e4a925f8/0xf32533d6ff7025f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7025e9 expref: 16 pid: 6486 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812989.441720:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788812989.441729:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cba22a99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:3625:x1875706313187200:12345-0@lo:103: 00010000:00010000:0.0:1788812989.441743:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788812989.441747:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702698 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70268a expref: 16 pid: 6488 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.441759:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff70268a expref: 16 pid: 6488 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.441776:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702698 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff70268a expref: 16 pid: 6488 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.441791:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788812989.441855:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cba22a99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:3625:x1875706313187200:12345-0@lo:103: Request processed in 128us (3649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812989.441862:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788812989.441880:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788812989.441885:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000028f6a8b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:3627:x1875706313187328:12345-0@lo:103: 00010000:00010000:0.0:1788812989.441893:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788812989.441896:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e4a925f8/0xf32533d6ff7025f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7025e9 expref: 14 pid: 6486 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.441904:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e4a925f8/0xf32533d6ff7025f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7025e9 expref: 14 pid: 6486 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.441919:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e4a925f8/0xf32533d6ff7025f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7025e9 expref: 14 pid: 6486 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.441947:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006f3530a7/0xf32533d6ff7026d0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.441955:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f3530a7/0xf32533d6ff7026d0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788812989.441969:0:6479:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007561820s 00010000:00010000:0.0:1788812989.441973:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006f3530a7/0xf32533d6ff7026d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.441980:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006f3530a7/0xf32533d6ff7026d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.441986:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006f3530a7/0xf32533d6ff7026d0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.441992:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006f3530a7/0xf32533d6ff7026d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.441998:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006f3530a7 already unused, calling callback (000000004f082eb1) 00010000:00010000:0.0:1788812989.442001:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006f3530a7/0xf32533d6ff7026d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.442008:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006f3530a7/0xf32533d6ff7026d0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.442022:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006f3530a7/0xf32533d6ff7026d0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.442043:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788812989.442071:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000028f6a8b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:3627:x1875706313187328:12345-0@lo:103: Request processed in 186us (3822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812989.442077:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788812989.442154:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c756f14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313187328:0@lo:103: 00000100:00100000:0.0:1788812989.442183:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000377debdc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313187200:0@lo:103: 00010000:00010000:0.0:1788812989.442199:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006f3530a7/0xf32533d6ff7026d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.442206:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006f3530a7/0xf32533d6ff7026d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812989.442211:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f3530a7/0xf32533d6ff7026d0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788812989.444419:0:7423:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1788812989.444793:0:7423:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788812989.445458:0:7423:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788812989.446683:0:7423:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788812989.446916:0:7423:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788812989.447103:0:7423:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788812989.448538:0:7423:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788812989.448904:0:7423:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788812989.449235:0:7423:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1788812989.449480:0:7423:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788812989.449802:0:7423:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1788812989.450073:0:7423:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1788812989.451367:0:7423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788812989.451544:0:7446:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788812989.451549:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788812989.452081:0:7447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1788812989.452134:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000092f6041 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7447:1875706313187456:0@lo:700: 00000100:00100000:2.0:1788812989.452212:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812989.452301:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ce28ab3 going to sleep for 11 seconds 00000040:01000000:3.0:1788812989.452395:0:7423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788812989.452491:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313187456 00000100:00100000:0.0:1788812989.452499:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313187456 00000100:00100000:3.0:1788812989.452842:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7448:1875706313187584:0@lo:1000: 00000100:00100000:3.0:1788812989.452878:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812989.452919:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 000000005f6ee5fd going to sleep for 11 seconds 00000040:01000000:2.0:1788812989.453379:0:7423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788812989.453484:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788812989.454121:0:7423:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788812989.454129:0:7423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788812989.454261:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788812989.454505:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313187584 00000100:00100000:1.0:1788812989.454512:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313187584 00000100:00100000:1.0:1788812989.454582:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788812989.454701:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f76036ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7448:x1875706313187584:12345-0@lo:1000: 00000100:00100000:1.0:1788812989.454799:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f76036ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7448:x1875706313187584:12345-0@lo:1000: Request processed in 102us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812989.454806:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788812989.454914:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7448:1875706313187584:0@lo:1000: 00000040:01000000:3.0:1788812989.454972:0:7448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1788812989.455003:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7448:1875706313187712:0@lo:700: 00000100:00100000:3.0:1788812989.455037:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812989.455070:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313187712 00000100:00100000:3.0:1788812989.455074:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313187712 00000100:00100000:3.0:1788812989.455101:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788812989.455106:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000034886175 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7448:x1875706313187712:12345-0@lo:700: 00000100:00100000:3.0:1788812989.455140:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000034886175 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7448:x1875706313187712:12345-0@lo:700: Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812989.455146:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788812989.455166:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a728c561 going to sleep for 11 seconds 00000100:00100000:3.0:1788812989.455178:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7448:1875706313187712:0@lo:700: 00000100:00100000:3.0:1788812989.455702:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7448:1875706313187840:0@lo:900: 00000100:00100000:3.0:1788812989.455753:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812989.455784:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313187840 00000100:00100000:3.0:1788812989.455789:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313187840 00000100:00100000:3.0:1788812989.455814:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788812989.455820:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009a2665b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7448:x1875706313187840:12345-0@lo:900: 00000100:00100000:3.0:1788812989.455853:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009a2665b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7448:x1875706313187840:12345-0@lo:900: Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812989.455859:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788812989.455877:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a728c561 going to sleep for 11 seconds 00010000:00080000:3.0:1788812989.455891:0:7448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004774ef72 x1875706313187840/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788813005 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788812989.455902:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7448:1875706313187840:0@lo:900: 00000100:00100000:3.0:1788812989.455998:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7448:1875706313187968:0@lo:1000: 00000100:00100000:3.0:1788812989.456025:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812989.456045:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da35f09e going to sleep for 11 seconds 00000100:00100000:1.0:1788812989.456371:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313187968 00000100:00100000:1.0:1788812989.456376:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313187968 00000100:00100000:1.0:1788812989.456401:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788812989.456406:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f003d61e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7448:x1875706313187968:12345-0@lo:1000: 00000100:00100000:1.0:1788812989.456466:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f003d61e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7448:x1875706313187968:12345-0@lo:1000: Request processed in 60us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812989.456473:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788812989.456697:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7448:1875706313187968:0@lo:1000: 00000004:00080000:3.0:1788812989.456737:0:7448:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000a728c561 with version 0 00000020:00100000:3.0:1788812989.456751:0:7448:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788812989.456756:0:7448:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004774ef72 x1875706313188224/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788812989.456769:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7448:1875706313188224:0@lo:1000: 00000100:00100000:3.0:1788812989.456791:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812989.457653:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bbab805f going to sleep for 11 seconds 00000100:00100000:0.0:1788812989.457770:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788812989.457781:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000947ca36a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7447:x1875706313187456:12345-0@lo:700: 00000040:00080000:2.0:1788812989.457795:0:7423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788812989.458754:0:7423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788812989.459106:0:7423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788812989.459518:0:7423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788812989.460080:0:7423:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:1.0:1788812989.460511:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313188224 00000100:00100000:1.0:1788812989.460521:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313188224 00000100:00100000:1.0:1788812989.460827:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788812989.460837:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f31629f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7448:x1875706313188224:12345-0@lo:1000: 40000000:02000000:1.0:1788812989.462256:0:6501:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:3.0:1788812989.462783:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788812989.462957:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788812989.463082:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788812989.463229:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788812989.463393:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788812989.463603:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788812989.463740:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788812989.463854:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788812989.464019:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788812989.464127:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788812989.464232:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788812989.464370:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788812989.464519:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788812989.464821:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788812989.464928:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788812989.465080:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788812989.465308:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788812989.465420:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788812989.471443:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788812989.471815:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788812989.472004:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788812989.472158:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000100:00100000:1.0:1788812989.472217:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000947ca36a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7447:x1875706313187456:12345-0@lo:700: Request processed in 14435us (20001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812989.472235:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:3.0:1788812989.472319:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788812989.472488:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788812989.472666:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788812989.472826:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788812989.472980:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788812989.473137:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788812989.473279:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788812989.473436:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00010000:00080000:2.0:1788812989.474763:0:7447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000092f6041 x1875706313187456/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788813005 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788812989.474784:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000092f6041 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7447:1875706313187456:0@lo:700: 40000000:02000000:2.0:1788812989.474798:0:7447:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:3.0:1788812989.474950:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788812989.475149:0:7423:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788812989.475370:0:7423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788812989.477194:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1788812989.477431:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f31629f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7448:x1875706313188224:12345-0@lo:1000: Request processed in 16592us (20635us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788812989.477458:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1788812989.478315:0:7448:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788812989.478321:0:7448:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788812989.478336:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7448:1875706313188224:0@lo:1000: 00000100:00100000:3.0:1788812989.478419:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7448:1875706313188352:0@lo:1000: 00000100:00100000:3.0:1788812989.478462:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812989.478514:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 000000005f6ee5fd going to sleep for 11 seconds 00000100:00100000:0.0:1788812989.478705:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313188352 00000100:00100000:0.0:1788812989.478712:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313188352 00000100:00100000:0.0:1788812989.478909:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788812989.478918:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e5c330b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7448:x1875706313188352:12345-0@lo:1000: 00000100:00100000:0.0:1788812989.479016:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e5c330b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7448:x1875706313188352:12345-0@lo:1000: Request processed in 99us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812989.479023:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788812989.479103:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7448:1875706313188352:0@lo:1000: 00000040:00080000:3.0:1788812989.479120:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788812989.479146:0:7448:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000a728c561 with version 1 00000004:00080000:0.0:1788812989.479186:0:7438:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000d1f7404e version 1 rpc_version 1 00000020:00100000:0.0:1788812989.479207:0:7438:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788812989.479213:0:7438:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000382da97d x1875706313188608/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788812989.479227:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000382da97d pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1875706313188608:0@lo:1000: 00000100:00100000:0.0:1788812989.479254:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812989.479383:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f49ac40a going to sleep for 11 seconds 00000100:00100000:1.0:1788812989.480150:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313188608 00000100:00100000:1.0:1788812989.480157:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313188608 00000100:00100000:1.0:1788812989.480190:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788812989.480196:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cba22a99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7438:x1875706313188608:12345-0@lo:1000: 00000001:00080000:0.0:1788812989.482832:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1788812989.482978:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cba22a99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7438:x1875706313188608:12345-0@lo:1000: Request processed in 2779us (3721us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788812989.482990:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788812989.483038:0:7438:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788812989.483042:0:7438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788812989.483059:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000382da97d pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1875706313188608:0@lo:1000: 00000001:00080000:0.0:1788812989.484044:0:7423:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788812989.484077:0:7423:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb26501cc7988 00100000:10000000:0.0:1788812989.484085:0:7423:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788812989.484709:0:7423:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788812989.484747:0:7423:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.113@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788812989.484768:0:7423:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788812989.484793:0:7423:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:3.0:1788812989.486519:0:7448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000020:00000004:1.0:1788812989.486707:0:7423:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788812989.486908:0:7423:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000004:00080000:3.0:1788812989.488854:0:7448:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788812989.505918:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788812989.509853:0:7447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788812989.509911:0:7447:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788812989.509915:0:7447:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1788812990.308666:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788812991.336194:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788812991.941721:0:7692:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788812992.356083:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788812992.465309:0:7744:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788812992.465509:0:7744:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788812993.380254:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788812994.404012:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788812994.404014:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788812994.404020:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a61047800 from 4 10000000:01000000:3.0:1788812994.404025:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788812994.404061:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 000000002a486cc0/0xf32533d6ff7026d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812994.404080:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 000000002a486cc0/0xf32533d6ff7026d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812994.404090:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 000000002a486cc0/0xf32533d6ff7026d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788812994.404112:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313188736:0@lo:101: 00000100:00100000:3.0:1788812994.404173:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812994.404218:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313188736 00000100:00100000:0.0:1788812994.404227:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313188736 00000100:00100000:0.0:1788812994.404294:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788812994.404304:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e0574a55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:6492:x1875706313188736:12345-0@lo:101: 00010000:00010000:0.0:1788812994.404316:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788812994.404328:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008b1cece7/0xf32533d6ff7026de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7026d7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788812994.404337:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 000000005f6140cc going to sleep for 11 seconds 00010000:00010000:0.0:1788812994.404351:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008b1cece7/0xf32533d6ff7026de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7026d7 expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812994.404373:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008b1cece7/0xf32533d6ff7026de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7026d7 expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812994.404381:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008b1cece7, rc 0) 00000100:00100000:0.0:1788812994.404432:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e0574a55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:6492:x1875706313188736:12345-0@lo:101: Request processed in 131us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812994.404439:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788812994.404516:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313188736:0@lo:101: 00010000:00010000:3.0:1788812994.404540:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 000000002a486cc0/0xf32533d6ff7026d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7026de expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812994.404550:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 000000002a486cc0/0xf32533d6ff7026d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7026de expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788812994.404593:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313188864:0@lo:256: 00000100:00100000:3.0:1788812994.404619:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812994.404687:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 000000005f6140cc going to sleep for 11 seconds 00000100:00100000:2.0:1788812994.404687:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313188864 00000100:00100000:2.0:1788812994.404693:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313188864 00000100:00100000:2.0:1788812994.404736:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788812994.404746:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c52db1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:6492:x1875706313188864:12345-0@lo:256: 20000000:01000000:2.0:1788812994.404762:0:6488:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788812994.404779:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788812994.404782:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788812994.404864:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c52db1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:6492:x1875706313188864:12345-0@lo:256: Request processed in 121us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812994.404871:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788812994.404914:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004774ef72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313188864:0@lo:256: 10000000:01000000:2.0:1788812994.404974:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788812994.404979:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 000000002a486cc0/0xf32533d6ff7026d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7026de expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.404985:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 000000002a486cc0/0xf32533d6ff7026d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7026de expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788812994.404992:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788812994.404993:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a60186000 from 21 10000000:01000000:2.0:1788812994.404995:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788812994.405016:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 000000002765ef56/0xf32533d6ff7026e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.405023:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 000000002765ef56/0xf32533d6ff7026e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.405030:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 000000002765ef56/0xf32533d6ff7026e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812994.405041:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000092f6041 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313188992:0@lo:101: 00000100:00100000:2.0:1788812994.405068:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812994.405087:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de0ba04c going to sleep for 11 seconds 00000100:00100000:1.0:1788812994.405104:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313188992 00000100:00100000:1.0:1788812994.405110:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313188992 00000100:00100000:1.0:1788812994.405139:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788812994.405145:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e9cd16b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:6492:x1875706313188992:12345-0@lo:101: 00010000:00010000:1.0:1788812994.405152:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788812994.405158:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b79c582e/0xf32533d6ff7026ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7026e5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.405171:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b79c582e/0xf32533d6ff7026ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7026e5 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.405179:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b79c582e/0xf32533d6ff7026ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7026e5 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.405185:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b79c582e, rc 0) 00000100:00100000:1.0:1788812994.405219:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e9cd16b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313188992:12345-0@lo:101: Request processed in 75us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812994.405231:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788812994.405252:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000092f6041 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313188992:0@lo:101: 00010000:00010000:2.0:1788812994.405267:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 000000002765ef56/0xf32533d6ff7026e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7026ec expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.405276:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 000000002765ef56/0xf32533d6ff7026e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7026ec expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812994.405326:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000092f6041 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313189120:0@lo:501: 00000100:00100000:2.0:1788812994.405346:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812994.405371:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de0ba04c going to sleep for 11 seconds 00000100:00100000:1.0:1788812994.405382:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313189120 00000100:00100000:1.0:1788812994.405387:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313189120 00000100:00100000:1.0:1788812994.405417:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788812994.405422:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c8ce7c9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313189120:12345-0@lo:501: 00000100:00100000:1.0:1788812994.405577:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c8ce7c9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313189120:12345-0@lo:501: Request processed in 155us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812994.405585:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788812994.405629:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000092f6041 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313189120:0@lo:501: 00000100:00100000:2.0:1788812994.405654:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000092f6041 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313189248:0@lo:503: 00000100:00100000:2.0:1788812994.405687:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812994.405801:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de0ba04c going to sleep for 11 seconds 00000100:00100000:1.0:1788812994.405832:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313189248 00000100:00100000:1.0:1788812994.405836:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313189248 00000100:00100000:1.0:1788812994.405860:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788812994.405865:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f5cfb86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313189248:12345-0@lo:503: 00000100:00100000:1.0:1788812994.406143:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f5cfb86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313189248:12345-0@lo:503: Request processed in 277us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812994.406151:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788812994.406210:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000092f6041 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313189248:0@lo:503: 00000100:00100000:0.0:1788812994.406418:0:7834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000382da97d pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:7834:1875706313189376:0@lo:502: 00000100:00100000:0.0:1788812994.406457:0:7834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812994.406488:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313189376 00000100:00100000:0.0:1788812994.406492:0:7834:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef130a0f going to sleep for 11 seconds 00000100:00100000:1.0:1788812994.406493:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313189376 00000100:00100000:1.0:1788812994.406520:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788812994.406538:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002856c3de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:7834:x1875706313189376:12345-0@lo:502: 00000100:00100000:1.0:1788812994.406609:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002856c3de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:7834:x1875706313189376:12345-0@lo:502: Request processed in 72us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812994.406616:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788812994.406635:0:7834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000382da97d pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:7834:1875706313189376:0@lo:502: 00000100:00100000:0.0:1788812994.406679:0:7834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000382da97d pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:7834:1875706313189504:0@lo:502: 00000100:00100000:0.0:1788812994.406712:0:7834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812994.406736:0:7834:0:(client.c:2716:ptlrpc_set_wait()) set 000000005bdef6fb going to sleep for 11 seconds 00000100:00100000:1.0:1788812994.406769:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313189504 00000100:00100000:1.0:1788812994.406773:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313189504 00000100:00100000:1.0:1788812994.406797:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788812994.406802:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae687fab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:7834:x1875706313189504:12345-0@lo:502: 00000100:00100000:1.0:1788812994.406874:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae687fab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:7834:x1875706313189504:12345-0@lo:502: Request processed in 73us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812994.406880:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788812994.406961:0:7834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000382da97d pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:7834:1875706313189504:0@lo:502: 00000040:00080000:2.0:1788812994.406978:0:7834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788812994.407044:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788812994.407067:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788812994.407074:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 000000002765ef56/0xf32533d6ff7026e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7026ec expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812994.407082:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 000000002765ef56/0xf32533d6ff7026e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7026ec expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788812994.407089:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788812994.407091:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a60186000 from 4 10000000:01000000:0.0:1788812994.407093:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788812994.407110:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 00000000e4867219/0xf32533d6ff7026f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812994.407124:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 00000000e4867219/0xf32533d6ff7026f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812994.407133:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 00000000e4867219/0xf32533d6ff7026f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812994.407144:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000770ba1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313189632:0@lo:101: 00000100:00100000:0.0:1788812994.407170:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812994.407196:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064ec347c going to sleep for 11 seconds 00000100:00100000:2.0:1788812994.407219:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313189632 00000100:00100000:2.0:1788812994.407224:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313189632 00000100:00100000:2.0:1788812994.407281:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788812994.407287:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000023a080c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313189632:12345-0@lo:101: 00010000:00010000:2.0:1788812994.407295:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788812994.407304:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e1dd91f/0xf32533d6ff7026fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7026f3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.407319:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e1dd91f/0xf32533d6ff7026fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7026f3 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.407327:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e1dd91f/0xf32533d6ff7026fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7026f3 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.407334:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e1dd91f, rc 0) 00000100:00100000:2.0:1788812994.407370:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000023a080c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313189632:12345-0@lo:101: Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812994.407377:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788812994.407383:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000770ba1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313189632:0@lo:101: 00010000:00010000:0.0:1788812994.407393:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 00000000e4867219/0xf32533d6ff7026f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7026fa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812994.407399:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 00000000e4867219/0xf32533d6ff7026f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7026fa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812994.407428:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000770ba1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313189760:0@lo:256: 00000100:00100000:0.0:1788812994.407450:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812994.407467:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064ec347c going to sleep for 11 seconds 00000100:00100000:1.0:1788812994.407483:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313189760 00000100:00100000:1.0:1788812994.407488:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313189760 00000100:00100000:1.0:1788812994.407515:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788812994.407521:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000011aebb4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313189760:12345-0@lo:256: 20000000:01000000:1.0:1788812994.407544:0:6486:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788812994.407557:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788812994.407560:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788812994.407635:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000011aebb4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313189760:12345-0@lo:256: Request processed in 114us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812994.407643:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788812994.407651:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000770ba1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313189760:0@lo:256: 10000000:01000000:0.0:1788812994.407692:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788812994.407696:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 00000000e4867219/0xf32533d6ff7026f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7026fa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812994.407703:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 00000000e4867219/0xf32533d6ff7026f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7026fa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788812994.407721:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788812994.407723:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788812994.407725:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788812994.407739:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff702701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812994.407744:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff702701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812994.407749:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff702701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812994.407756:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000770ba1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313189888:0@lo:101: 00000100:00100000:0.0:1788812994.407780:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812994.407797:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064ec347c going to sleep for 11 seconds 00000100:00100000:2.0:1788812994.407814:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313189888 00000100:00100000:2.0:1788812994.407820:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313189888 00000100:00100000:2.0:1788812994.407845:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788812994.407850:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005c820d17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313189888:12345-0@lo:101: 00010000:00010000:2.0:1788812994.407857:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788812994.407864:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4a925f8/0xf32533d6ff702708 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702701 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.407876:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4a925f8/0xf32533d6ff702708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702701 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.407882:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4a925f8/0xf32533d6ff702708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702701 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.407888:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4a925f8, rc 0) 00000100:00100000:2.0:1788812994.407926:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005c820d17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313189888:12345-0@lo:101: Request processed in 76us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812994.408119:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788812994.408192:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000770ba1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313189888:0@lo:101: 00010000:00010000:1.0:1788812994.408203:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff702701 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702708 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.408209:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff702701 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702708 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812994.408258:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c82ae14d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313190016:0@lo:501: 00000100:00100000:1.0:1788812994.408287:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812994.408318:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000074d3de4f going to sleep for 11 seconds 00000100:00100000:2.0:1788812994.408358:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313190016 00000100:00100000:2.0:1788812994.408362:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313190016 00000100:00100000:2.0:1788812994.408423:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788812994.408430:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000965adc6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313190016:12345-0@lo:501: 00000100:00100000:2.0:1788812994.408543:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000965adc6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313190016:12345-0@lo:501: Request processed in 115us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812994.408550:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788812994.408814:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c82ae14d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313190016:0@lo:501: 00000100:00100000:3.0:1788812994.408843:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c0a5f27a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313190144:0@lo:503: 00000100:00100000:3.0:1788812994.408881:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812994.408905:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028ba0633 going to sleep for 11 seconds 00000100:00100000:2.0:1788812994.409000:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313190144 00000100:00100000:2.0:1788812994.409010:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313190144 00000100:00100000:2.0:1788812994.409062:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788812994.409067:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f3c78bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313190144:12345-0@lo:503: 00000100:00100000:2.0:1788812994.409127:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f3c78bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313190144:12345-0@lo:503: Request processed in 60us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812994.409134:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788812994.409146:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c0a5f27a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313190144:0@lo:503: 00000100:00100000:0.0:1788812994.417716:0:7836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bfe218f1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:7836:1875706313190272:0@lo:502: 00000100:00100000:0.0:1788812994.417802:0:7836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812994.417847:0:7836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000290db164 going to sleep for 11 seconds 00000100:00100000:1.0:1788812994.418192:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313190272 00000100:00100000:1.0:1788812994.418199:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313190272 00000100:00100000:1.0:1788812994.418248:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788812994.418256:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005a433c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:7836:x1875706313190272:12345-0@lo:502: 00000100:00100000:1.0:1788812994.418398:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005a433c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:7836:x1875706313190272:12345-0@lo:502: Request processed in 142us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812994.418406:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788812994.418512:0:7836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bfe218f1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:7836:1875706313190272:0@lo:502: 00000020:01000000:3.0:1788812994.418564:0:7836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788812994.418575:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788812994.418578:0:7836:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788812994.418582:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788812994.418586:0:7836:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:00000080:3.0:1788812994.418609:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788812994.418622:0:7836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000a102dd30) 00000020:00000080:3.0:1788812994.418645:0:7836:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1788812994.418651:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788812994.418734:0:7836:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788812994.418740:0:7836:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788812994.418747:0:7836:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff702716 00010000:00080000:3.0:1788812994.418775:0:7836:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000374afb6f@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.113@tcp at head 00010000:00010000:3.0:1788812994.420700:0:7836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788812994.422481:0:7836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788812994.422500:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788812994.422553:0:7836:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788812994.422581:0:7836:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff70271d 00000100:00080000:1.0:1788812994.422592:0:7836:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788812994.422603:0:7836:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000374afb6f using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788812994.422642:0:7836:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b4914d95 x1875706313190400/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788812994.422665:0:7836:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1788812994.422720:0:7836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788812994.422765:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c0a5f27a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313190528:0@lo:400: 00000100:00100000:1.0:1788812994.422776:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4914d95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313190400:0@lo:38: 00000100:00100000:3.0:1788812994.422834:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812994.422835:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812994.422893:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001dc99b13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313190656:0@lo:400: 00000100:00100000:1.0:1788812994.422899:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313190400 00000100:00100000:1.0:1788812994.422907:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313190400 00000100:00100000:3.0:1788812994.422918:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812994.422957:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313190656 00000100:00100000:1.0:1788812994.422960:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313190656 00000100:00100000:3.0:1788812994.422963:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788812994.422971:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e867eb12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313190784:0@lo:400: 00000100:00100000:1.0:1788812994.422994:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788812994.422998:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812994.423004:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d31bd30c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875706313190400:12345-0@lo:38: 00010000:00080000:1.0:1788812994.423027:0:6500:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 147 last 0 00000100:00100000:3.0:1788812994.423043:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313190528 00000100:00100000:3.0:1788812994.423049:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313190528 00000020:00000080:1.0:1788812994.423060:0:6500:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff702724 00000004:00100000:1.0:1788812994.423075:0:6500:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788812994.423081:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313190784 00000001:00000004:1.0:1788812994.423081:0:6500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788812994.423086:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313190784 00000100:00100000:3.0:1788812994.423102:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788812994.423109:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004774ef72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313190528:12345-0@lo:400: 00000100:00100000:3.0:1788812994.423158:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004774ef72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313190528:12345-0@lo:400: Request processed in 50us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812994.423170:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788812994.423186:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788812994.423190:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000117a45b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313190784:12345-0@lo:400: 00000100:00100000:3.0:1788812994.423226:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000117a45b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313190784:12345-0@lo:400: Request processed in 35us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812994.423232:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788812994.423273:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e867eb12 x1875706313190784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788812994.423285:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e867eb12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313190784:0@lo:400: 00010000:00080000:3.0:1788812994.423307:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c0a5f27a x1875706313190528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788812994.423315:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c0a5f27a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313190528:0@lo:400: 00000100:00080000:3.0:1788812994.424497:0:7844:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000c0a5f27a x1875706313190912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000020:01000000:1.0:1788812994.424502:0:7836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788812994.424510:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:3.0:1788812994.424513:0:7844:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7e9ddc4 going to sleep for 0 seconds 00000020:00000080:1.0:1788812994.424519:0:7836:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788812994.424537:0:7836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788812994.424542:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788812994.424544:0:7836:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788812994.424549:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788812994.424551:0:7836:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788812994.424572:0:7836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c82ae14d pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:7836:1875706313191040:0@lo:502: 00000100:00100000:1.0:1788812994.424624:0:7836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812994.424660:0:7836:0:(client.c:2716:ptlrpc_set_wait()) set 000000001fd896c2 going to sleep for 11 seconds 00000100:00100000:3.0:1788812994.424675:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313191040 00000100:00100000:3.0:1788812994.424682:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313191040 00000100:00100000:3.0:1788812994.424736:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788812994.424744:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000079ef87be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:7836:x1875706313191040:12345-0@lo:502: 00000100:00100000:3.0:1788812994.424877:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000079ef87be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:7836:x1875706313191040:12345-0@lo:502: Request processed in 134us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812994.424885:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788812994.424963:0:7836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c82ae14d pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:7836:1875706313191040:0@lo:502: 00000020:01000000:1.0:1788812994.424986:0:7836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788812994.424989:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788812994.424990:0:7836:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788812994.424993:0:7836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788812994.425251:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788812994.425275:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788812994.425284:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff702701 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702708 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812994.425300:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff702701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702708 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788812994.425311:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788812994.425314:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff948a506e4d40 from 1 10000000:01000000:3.0:1788812994.425316:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788812994.425340:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 00000000a0af4f8d/0xf32533d6ff70272b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812994.425347:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 00000000a0af4f8d/0xf32533d6ff70272b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812994.425355:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 00000000a0af4f8d/0xf32533d6ff70272b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788812994.425368:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e867eb12 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313191168:0@lo:101: 00000100:00100000:3.0:1788812994.425398:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812994.425435:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313191168 00000100:00100000:3.0:1788812994.425436:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bde332f3 going to sleep for 11 seconds 00000100:00100000:0.0:1788812994.425441:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313191168 00000100:00100000:0.0:1788812994.425471:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788812994.425478:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000cba73b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313191168:12345-0@lo:101: 00010000:00010000:0.0:1788812994.425487:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788812994.425498:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702732 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70272b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812994.425518:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70272b expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812994.425551:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70272b expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812994.425559:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000222ef3b9, rc 0) 00000100:00100000:0.0:1788812994.425597:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000cba73b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313191168:12345-0@lo:101: Request processed in 119us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812994.425605:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788812994.425626:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e867eb12 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313191168:0@lo:101: 00010000:00010000:3.0:1788812994.425640:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 00000000a0af4f8d/0xf32533d6ff70272b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702732 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812994.425650:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 00000000a0af4f8d/0xf32533d6ff70272b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702732 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788812994.425946:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e867eb12 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313191296:0@lo:501: 00000100:00100000:3.0:1788812994.425978:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812994.426018:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bde332f3 going to sleep for 11 seconds 00000100:00100000:1.0:1788812994.426558:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313191296 00000100:00100000:1.0:1788812994.426564:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313191296 00000100:00100000:1.0:1788812994.426600:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788812994.426607:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000177529a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313191296:12345-0@lo:501: 00000100:00100000:1.0:1788812994.426686:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000177529a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313191296:12345-0@lo:501: Request processed in 81us (709us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788812994.426693:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788812994.426761:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e867eb12 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313191296:0@lo:501: 10000000:01000000:0.0:1788812994.426786:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788812994.426791:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 00000000a0af4f8d/0xf32533d6ff70272b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702732 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812994.426798:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 00000000a0af4f8d/0xf32533d6ff70272b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702732 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788812994.432458:0:6500:0:(import.c:65:import_set_state_nolock()) 0000000003c91834 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788812994.432676:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d31bd30c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1875706313190400:12345-0@lo:38: Request processed in 9671us (9843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812994.432686:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788812994.432716:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788812994.432726:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006a0e1395 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313190656:12345-0@lo:400: 00000100:00100000:1.0:1788812994.432778:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006a0e1395 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313190656:12345-0@lo:400: Request processed in 56us (9860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812994.432796:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788812994.432803:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001dc99b13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313190656:0@lo:400: 00000100:00100000:2.0:1788812994.432887:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788812994.432895:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788812994.432903:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788812994.432908:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788812994.432910:0:3624:0:(import.c:65:import_set_state_nolock()) 00000000374afb6f lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788812994.433043:0:3624:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c7e9ddc4): req@00000000c0a5f27a x1875706313190912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788812994.433068:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4914d95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313190400:0@lo:38: 00000100:00100000:1.0:1788812994.433181:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788812994.433192:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c82ae14d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313191424:0@lo:41: 00000100:00100000:1.0:1788812994.433230:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812994.433269:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313191424 00000100:00100000:1.0:1788812994.433275:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313191424 00000100:00100000:1.0:1788812994.433305:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788812994.433312:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000377debdc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313191424:12345-0@lo:41: 00000004:00000024:1.0:1788812994.433345:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788812994.433388:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000377debdc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313191424:12345-0@lo:41: Request processed in 77us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812994.433396:0:7844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812994.433401:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788812994.433415:0:7844:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7e9ddc4 going to sleep for 11 seconds 00000100:00100000:1.0:1788812994.433417:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313190912 00000100:00100000:1.0:1788812994.433423:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313190912 00000100:00100000:1.0:1788812994.433443:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788812994.433448:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003fe64d30 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7844:x1875706313190912:12345-0@lo:1000: 00000100:00100000:1.0:1788812994.433518:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003fe64d30 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7844:x1875706313190912:12345-0@lo:1000: Request processed in 70us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812994.433536:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788812994.433559:0:7844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c0a5f27a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7844:1875706313190912:0@lo:1000: 00000100:00100000:1.0:1788812994.433579:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c82ae14d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313191424:0@lo:41: 00000040:01000000:0.0:1788812994.433591:0:7844:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788812994.433632:0:7844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c13f13ad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7844:1875706313191552:0@lo:1000: 00000100:00100000:0.0:1788812994.433676:0:7844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812994.433700:0:7844:0:(client.c:2716:ptlrpc_set_wait()) set 000000001b6cd30d going to sleep for 11 seconds 00000100:00100000:3.0:1788812994.434036:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313191552 00000100:00100000:3.0:1788812994.434040:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313191552 00000100:00100000:3.0:1788812994.434077:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788812994.434086:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007aacb315 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7844:x1875706313191552:12345-0@lo:1000: 00000100:00100000:3.0:1788812994.434216:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007aacb315 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7844:x1875706313191552:12345-0@lo:1000: Request processed in 133us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812994.434224:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788812994.434268:0:7844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c13f13ad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7844:1875706313191552:0@lo:1000: 00000100:00100000:0.0:1788812994.434310:0:7844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c13f13ad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7844:1875706313191680:0@lo:700: 00000100:00100000:0.0:1788812994.434337:0:7844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812994.434366:0:7844:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1c8fcdf going to sleep for 11 seconds 00000100:00100000:3.0:1788812994.434383:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313191680 00000100:00100000:3.0:1788812994.434388:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313191680 00000100:00100000:3.0:1788812994.434428:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788812994.434435:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe218f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7844:x1875706313191680:12345-0@lo:700: 00000100:00100000:3.0:1788812994.434484:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe218f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7844:x1875706313191680:12345-0@lo:700: Request processed in 50us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812994.434490:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788812994.434511:0:7844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c13f13ad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7844:1875706313191680:0@lo:700: 00000100:00100000:1.0:1788812994.434669:0:7844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c82ae14d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7844:1875706313191808:0@lo:1000: 00000100:00100000:1.0:1788812994.434692:0:7844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812994.434710:0:7844:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0925c92 going to sleep for 11 seconds 00000100:00100000:0.0:1788812994.434728:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313191808 00000100:00100000:0.0:1788812994.434734:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313191808 00000100:00100000:0.0:1788812994.434771:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788812994.434779:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000c756f14 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7844:x1875706313191808:12345-0@lo:1000: 00000100:00100000:0.0:1788812994.434836:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000c756f14 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7844:x1875706313191808:12345-0@lo:1000: Request processed in 59us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812994.434844:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788812994.434856:0:7844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c82ae14d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7844:1875706313191808:0@lo:1000: 00000004:00080000:1.0:1788812994.434905:0:7844:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000074d3de4f with version 0 00000020:00100000:1.0:1788812994.434920:0:7844:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788812994.434926:0:7844:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c82ae14d x1875706313192064/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788812994.434975:0:7844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c82ae14d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7844:1875706313192064:0@lo:1000: 00000100:00100000:1.0:1788812994.435001:0:7844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812994.435019:0:7844:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0925c92 going to sleep for 11 seconds 00000100:00100000:0.0:1788812994.435022:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313192064 00000100:00100000:0.0:1788812994.435029:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313192064 00000100:00100000:0.0:1788812994.435068:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788812994.435074:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002d5c01e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7844:x1875706313192064:12345-0@lo:1000: 00000001:00080000:3.0:1788812994.436900:0:7425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1788812994.436909:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788812994.438248:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002d5c01e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7844:x1875706313192064:12345-0@lo:1000: Request processed in 3171us (3243us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788812994.438261:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:1.0:1788812994.438278:0:7844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788812994.438283:0:7844:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788812994.438298:0:7844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c82ae14d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7844:1875706313192064:0@lo:1000: 00000100:00100000:1.0:1788812994.438368:0:7844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c82ae14d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7844:1875706313192192:0@lo:1000: 00000100:00100000:1.0:1788812994.438401:0:7844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812994.438445:0:7844:0:(client.c:2716:ptlrpc_set_wait()) set 000000002286f86c going to sleep for 11 seconds 00000100:00100000:3.0:1788812994.438446:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313192192 00000100:00100000:3.0:1788812994.438453:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313192192 00000100:00100000:3.0:1788812994.438490:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788812994.438497:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004380f93e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7844:x1875706313192192:12345-0@lo:1000: 00000100:00100000:3.0:1788812994.438570:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004380f93e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7844:x1875706313192192:12345-0@lo:1000: Request processed in 74us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812994.438577:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788812994.438707:0:7844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c82ae14d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7844:1875706313192192:0@lo:1000: 00000040:00080000:1.0:1788812994.438721:0:7844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788812994.438747:0:7844:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b0925c92 with version 1 00000004:00080000:0.0:1788812994.438781:0:7839:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000048126608 version 1 rpc_version 1 00000020:00100000:0.0:1788812994.438800:0:7839:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788812994.438805:0:7839:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000770ba1a x1875706313192448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788812994.438818:0:7839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000770ba1a pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7839:1875706313192448:0@lo:1000: 00000100:00100000:0.0:1788812994.438845:0:7839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812994.438867:0:7839:0:(client.c:2716:ptlrpc_set_wait()) set 000000001b6cd30d going to sleep for 11 seconds 00000100:00100000:3.0:1788812994.438892:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313192448 00000100:00100000:3.0:1788812994.438897:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313192448 00000100:00100000:3.0:1788812994.438924:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788812994.438957:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000382da97d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7839:x1875706313192448:12345-0@lo:1000: 00000001:00080000:3.0:1788812994.440213:0:7425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1788812994.440280:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000382da97d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7839:x1875706313192448:12345-0@lo:1000: Request processed in 1323us (1433us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788812994.440289:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1788812994.440326:0:7839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788812994.440330:0:7839:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788812994.440341:0:7839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000770ba1a pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7839:1875706313192448:0@lo:1000: 00000040:00080000:1.0:1788812994.441377:0:7844:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788812994.441442:0:7844:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788812994.441447:0:7844:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1788812994.450712:0:7851:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788812994.450912:0:7851:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788812994.916179:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000314e950e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313192576:0@lo:41: 00000100:00100000:1.0:1788812994.916253:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812994.916452:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313192576 00000100:00100000:0.0:1788812994.916461:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313192576 00000100:00100000:0.0:1788812994.916547:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788812994.916557:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c82ae14d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313192576:12345-0@lo:41: 00000004:00000024:0.0:1788812994.916598:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788812994.916648:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c82ae14d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313192576:12345-0@lo:41: Request processed in 93us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812994.916654:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788812994.916738:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000314e950e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313192576:0@lo:41: 00000020:00000080:1.0:1788812994.987211:0:7899:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9e0e6fb0 20000000:00000080:1.0:1788812994.987231:0:7899:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff948a7b71d400 uarg=0000000000000000 20000000:01000000:1.0:1788812994.987267:0:7899:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788812994.987280:0:7899:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788812994.987285:0:7899:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788812994.987350:0:7899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788812994.987359:0:7899:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788812994.989848:0:7899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788812994.990085:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788812994.990113:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788812994.990126:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788812994.990138:0:7899:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788812994.990155:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006f3530a7/0xf32533d6ff702739 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.990183:0:7899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003e495769/0xf32533d6ff7025b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7025b1 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.990191:0:7899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000aa540725/0xf32533d6ff7026a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70269f expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.990195:0:7899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006f3530a7/0xf32533d6ff702739 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.990227:0:7899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000aa540725/0xf32533d6ff7026a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff70269f expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.990236:0:7899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000aa540725/0xf32533d6ff7026a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff70269f expref: 17 pid: 6488 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812994.990246:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fe583de pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7899:1875706313192704:0@lo:104: 00000100:00100000:1.0:1788812994.990293:0:7899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788812994.990339:0:7899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003e495769/0xf32533d6ff7025b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7025b1 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812994.990339:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788812994.990352:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313192704 00010000:00010000:1.0:1788812994.990355:0:7899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003e495769/0xf32533d6ff7025b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7025b1 expref: 17 pid: 6487 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812994.990358:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313192704 00000100:00100000:1.0:1788812994.990363:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071affc89 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7899:1875706313192832:0@lo:104: 00000100:00100000:1.0:1788812994.990401:0:7899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812994.990548:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078b13961 going to sleep for 11 seconds 00000100:00100000:0.0:1788812994.990582:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313192832 00000100:00100000:0.0:1788812994.990585:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313192832 00000100:00100000:0.0:1788812994.990601:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788812994.990605:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000091c919cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:7899:x1875706313192704:12345-0@lo:104: 00010000:00010000:0.0:1788812994.990614:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70269f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7026a6 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812994.990659:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788812994.990663:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000091c919cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:7899:x1875706313192704:12345-0@lo:104: Request processed in 58us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812994.990669:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788812994.990681:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fe583de pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7899:1875706313192704:0@lo:104: 00000100:00100000:0.0:1788812994.990704:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788812994.990711:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004d0bb523 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:7899:x1875706313192832:12345-0@lo:104: 00010000:00010000:0.0:1788812994.990719:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff7025b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7025b8 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.990749:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788812994.990803:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071affc89 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7899:1875706313192832:0@lo:104: 00010000:00010000:1.0:1788812994.990817:0:7899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006f3530a7/0xf32533d6ff702739 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812994.990848:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788812994.990854:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004d0bb523 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:7899:x1875706313192832:12345-0@lo:104: Request processed in 144us (452us total) trans 0 rc 0/0 00010000:00010000:2.0:1788812994.990856:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70269f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7026a6 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812994.990867:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788812994.990882:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f80fd231 already unused, calling callback (00000000fec9925f) 00010000:00010000:0.0:1788812994.990895:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1788812994.990897:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70269f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7026a6 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.990914:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70269f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7026a6 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788812994.990923:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70269f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7026a6 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788812994.991240:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788812994.991294:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70269f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7026a6 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.991299:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788812994.991322:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70269f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7026a6 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.991327:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: 00000000f80fd231/0xf32533d6ff70269f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7026a6 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.991344:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788812994.991348:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000092f6041 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313192960:0@lo:103: 00010000:00010000:2.0:1788812994.991349:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788812994.991354:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788812994.991393:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812994.991443:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313192960 00000100:00100000:2.0:1788812994.991450:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313192960 00010000:00010000:2.0:1788812994.991484:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000aa540725/0xf32533d6ff7026a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70269f expref: 18 pid: 6488 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812994.991516:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788812994.991536:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001dc99b13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:3625:x1875706313192960:12345-0@lo:103: 00010000:00010000:2.0:1788812994.991547:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788812994.991554:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000aa540725/0xf32533d6ff7026a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70269f expref: 18 pid: 6488 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.991614:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000aa540725/0xf32533d6ff7026a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff70269f expref: 18 pid: 6488 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.991629:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aa540725/0xf32533d6ff7026a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff70269f expref: 18 pid: 6488 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812994.991649:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788812994.991669:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788812994.991673:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788812994.991675:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788812994.991684:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff7025b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7025b8 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.991694:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000093573cca already unused, calling callback (00000000fec9925f) 10000000:00010000:1.0:1788812994.991698:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff7025b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7025b8 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.991707:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff7025b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7025b8 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812994.991708:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001dc99b13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:3625:x1875706313192960:12345-0@lo:103: Request processed in 174us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812994.991725:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:00010000:1.0:1788812994.991737:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff7025b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7025b8 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788812994.991743:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788812994.991750:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000092f6041 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313192960:0@lo:103: 00010000:00010000:1.0:1788812994.991778:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff7025b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7025b8 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.991797:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788812994.991819:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff7025b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7025b8 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.991826:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff7025b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7025b8 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788812994.991831:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071affc89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313193088:0@lo:103: 00010000:00010000:1.0:1788812994.991842:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788812994.991844:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788812994.991845:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788812994.991859:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812994.991923:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313193088 00000100:00100000:1.0:1788812994.991928:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313193088 00010000:00010000:1.0:1788812994.991973:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003e495769/0xf32533d6ff7025b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7025b1 expref: 17 pid: 6487 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812994.992002:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788812994.992014:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000090e11a8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:3626:x1875706313193088:12345-0@lo:103: 00010000:00010000:1.0:1788812994.992024:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788812994.992028:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003e495769/0xf32533d6ff7025b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7025b1 expref: 17 pid: 6487 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.992037:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003e495769/0xf32533d6ff7025b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7025b1 expref: 17 pid: 6487 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.992048:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e495769/0xf32533d6ff7025b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7025b1 expref: 17 pid: 6487 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.992060:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006f3530a7/0xf32533d6ff702739 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.992077:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f3530a7/0xf32533d6ff702739 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.992089:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006f3530a7/0xf32533d6ff702739 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.992094:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006f3530a7/0xf32533d6ff702739 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.992100:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006f3530a7/0xf32533d6ff702739 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.992106:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006f3530a7/0xf32533d6ff702739 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.992111:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006f3530a7 already unused, calling callback (000000004f082eb1) 00010000:00010000:1.0:1788812994.992113:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006f3530a7/0xf32533d6ff702739 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.992120:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006f3530a7/0xf32533d6ff702739 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.992138:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006f3530a7/0xf32533d6ff702739 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812994.992146:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788812994.992159:0:7899:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006f3530a7/0xf32533d6ff702739 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812994.992166:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006f3530a7/0xf32533d6ff702739 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788812994.992172:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f3530a7/0xf32533d6ff702739 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812994.992297:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000090e11a8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:3626:x1875706313193088:12345-0@lo:103: Request processed in 288us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812994.992303:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788812994.993007:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071affc89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313193088:0@lo:103: 00010000:00010000:2.0:1788812995.428115:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788812996.452082:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788812997.476150:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788812998.501731:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788812999.524294:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039d2ffb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313193216:0@lo:400: 00000100:00100000:3.0:1788812999.524374:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812999.524422:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e867eb12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313193728:0@lo:400: 00000100:00100000:3.0:1788812999.524466:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812999.524515:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788812999.524522:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000293d5d05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313193344:0@lo:400: 00000100:00100000:3.0:1788812999.524547:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788812999.524593:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313193344 00000100:00100000:3.0:1788812999.524600:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313193344 00000100:00100000:3.0:1788812999.524646:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788812999.524655:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000854e6434 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313193344:12345-0@lo:400: 00000100:00100000:3.0:1788812999.524706:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000854e6434 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313193344:12345-0@lo:400: Request processed in 52us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812999.524714:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788812999.524760:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000293d5d05 x1875706313193344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788812999.524774:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000293d5d05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313193344:0@lo:400: 00000100:00100000:0.0:1788812999.525229:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca1769aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313193472:0@lo:400: 00000100:00100000:0.0:1788812999.525259:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812999.525281:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788812999.525287:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c0a5f27a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313193600:0@lo:400: 00000100:00100000:0.0:1788812999.525309:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812999.525339:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313193216 00000100:00100000:0.0:1788812999.525344:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313193216 00000100:00100000:0.0:1788812999.525371:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788812999.525377:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000344a44d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:3627:x1875706313193216:12345-0@lo:400: 00000100:00100000:0.0:1788812999.525413:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000344a44d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:3627:x1875706313193216:12345-0@lo:400: Request processed in 36us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812999.525419:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788812999.525448:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313193728 00000100:00100000:0.0:1788812999.525452:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313193728 00000100:00100000:0.0:1788812999.525467:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313193472 00000100:00100000:0.0:1788812999.525469:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313193472 00000100:00100000:0.0:1788812999.525492:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788812999.525498:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000095529ac2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313193728:12345-0@lo:400: 00000100:00100000:0.0:1788812999.525540:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000095529ac2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313193728:12345-0@lo:400: Request processed in 32us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812999.525546:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788812999.525558:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788812999.525562:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000032f5f2d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313193472:12345-0@lo:400: 00000100:00100000:0.0:1788812999.525602:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000032f5f2d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313193472:12345-0@lo:400: Request processed in 40us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812999.525609:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788812999.525629:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313193600 00000100:00100000:0.0:1788812999.525633:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313193600 00000100:00100000:0.0:1788812999.525658:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788812999.525665:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000052ec1b0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313193600:12345-0@lo:400: 00000100:00100000:0.0:1788812999.525694:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000052ec1b0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313193600:12345-0@lo:400: Request processed in 31us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812999.525699:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788812999.525759:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788812999.525776:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c0a5f27a x1875706313193600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788812999.525786:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c0a5f27a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313193600:0@lo:400: 00000100:00100000:0.0:1788812999.525795:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca1769aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313193472:0@lo:400: 00000100:00100000:0.0:1788812999.525820:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039d2ffb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313193216:0@lo:400: 00000100:00100000:0.0:1788812999.525828:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e867eb12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313193728:0@lo:400: 00000100:00100000:1.0:1788812999.526681:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5de8488 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313193856:0@lo:41: 00000100:00100000:1.0:1788812999.526732:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812999.526822:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313193856 00000100:00100000:1.0:1788812999.526827:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313193856 00000100:00100000:1.0:1788812999.526898:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788812999.526908:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001fe583de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313193856:12345-0@lo:41: 00000004:00000024:1.0:1788812999.526963:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788812999.527013:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001fe583de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313193856:12345-0@lo:41: Request processed in 108us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812999.527019:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788812999.527084:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5de8488 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313193856:0@lo:41: 00000100:00100000:1.0:1788813000.036319:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079fcfc63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313193984:0@lo:41: 00000100:00100000:1.0:1788813000.036387:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813000.036558:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313193984 00000100:00100000:3.0:1788813000.036567:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313193984 00000100:00100000:3.0:1788813000.036622:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813000.036632:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035dbd858 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313193984:12345-0@lo:41: 00000004:00000024:3.0:1788813000.036664:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788813000.036718:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035dbd858 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313193984:12345-0@lo:41: Request processed in 89us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813000.036725:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813000.036767:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079fcfc63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313193984:0@lo:41: 00000020:01000004:3.0:1788813000.224375:0:8398:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788813000.224379:0:8398:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788813000.224381:0:8398:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788813000.224528:0:8398:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000046db784c 00000020:01000004:3.0:1788813000.224544:0:8398:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788813000.224556:0:8398:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788813000.224586:0:8398:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000002817c335) 00000020:00000080:3.0:1788813000.224602:0:8398:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788813000.240642:0:8398:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788813000.240709:0:8398:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1788813000.253120:0:8398:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788813000.253322:0:8398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788813000.253334:0:8398:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788813000.253344:0:8398:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf32533d6ff702747 00000020:01000004:3.0:1788813000.253351:0:8398:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788813000.253373:0:8398:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788813000.253376:0:8398:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788813000.253382:0:8398:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788813000.253388:0:8398:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788813000.253397:0:8398:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000009850dab4) 00000020:00000080:3.0:1788813000.253410:0:8398:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1788813000.255123:0:8398:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813000.255290:0:8398:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788813000.255296:0:8398:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788813000.256042:0:8398:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788813000.256050:0:8398:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788813000.256391:0:8398:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788813000.256399:0:8398:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788813000.257824:0:8398:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813000.257986:0:8398:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788813000.257991:0:8398:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788813000.258327:0:8398:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788813000.258333:0:8398:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788813000.276406:0:8398:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813000.276608:0:8398:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788813000.276614:0:8398:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788813000.277493:0:8398:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788813000.277499:0:8398:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788813000.279093:0:8398:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788813000.279108:0:8398:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788813000.282522:0:8398:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813000.282667:0:8398:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788813000.282673:0:8398:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788813000.283039:0:8398:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788813000.283045:0:8398:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788813000.310448:0:8398:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813000.310688:0:8398:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788813000.310694:0:8398:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788813000.312486:0:8398:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788813000.312498:0:8398:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788813000.313072:0:8398:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788813000.313100:0:8398:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788813000.313107:0:8398:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788813000.324314:0:8398:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788813000.324358:0:8398:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.113@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788813000.324363:0:8398:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788813000.324365:0:8398:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788813000.324366:0:8398:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813000.324367:0:8398:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813000.324368:0:8398:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813000.324370:0:8398:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813000.324371:0:8398:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813000.324372:0:8398:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788813000.324374:0:8398:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788813000.324375:0:8398:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813000.324376:0:8398:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813000.324379:0:8398:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788813000.324382:0:8398:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788813000.324383:0:8398:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788813000.324385:0:8398:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813000.324386:0:8398:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813000.324387:0:8398:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813000.324388:0:8398:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813000.324389:0:8398:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813000.324390:0:8398:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788813000.324391:0:8398:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788813000.324397:0:8398:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813000.324398:0:8398:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813000.324423:0:8398:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788813000.324440:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025dc57ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313194112:0@lo:253: 00000100:00100000:3.0:1788813000.324518:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813000.324626:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017c30139 going to sleep for 11 seconds 00000100:00100000:2.0:1788813000.324676:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313194112 00000100:00100000:2.0:1788813000.324684:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313194112 00000100:00100000:2.0:1788813000.324771:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788813000.324780:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000442fa57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:8398:x1875706313194112:12345-0@lo:253: 20000000:01000000:2.0:1788813000.324808:0:6486:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788813000.324813:0:6486:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788813000.324818:0:6486:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788813000.324821:0:6486:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788813000.325357:0:6486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813000.326612:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788813000.326634:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788813000.326658:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788813000.326665:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788813000.326678:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788813000.326694:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788813000.326792:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788813000.326809:0:6486:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.113@tcp 20000000:01000000:3.0:1788813000.326811:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.113@tcp (null) (null) (null) 00000040:00080000:3.0:1788813000.326824:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788813000.326829:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788813000.326839:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788813000.326843:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.113@tcp (null) (null) 00000040:00080000:3.0:1788813000.326853:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788813000.326860:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788813000.326872:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788813000.326888:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788813000.327137:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1788813000.327150:0:6486:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.113@tcp 20000000:01000000:3.0:1788813000.327152:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.113@tcp (null) (null) (null) 00000040:00080000:3.0:1788813000.327167:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1788813000.327172:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788813000.327202:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1788813000.327208:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.113@tcp (null) (null) 00000040:00080000:3.0:1788813000.327230:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1788813000.327236:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788813000.327249:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1788813000.327263:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1788813000.327695:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1788813000.327709:0:6486:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.113@tcp 20000000:01000000:3.0:1788813000.327710:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.113@tcp (null) (null) (null) 00000040:00080000:3.0:1788813000.327724:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1788813000.327730:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788813000.327742:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1788813000.327747:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.113@tcp (null) (null) 00000040:00080000:3.0:1788813000.327759:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1788813000.327765:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788813000.327775:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1788813000.327789:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1788813000.327802:0:6486:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788813000.327804:0:6486:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788813000.327808:0:6486:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788813000.327850:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788813000.327853:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788813000.328407:0:8417:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1788813000.328428:0:8417:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1788813000.328443:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788813000.328640:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1788813000.328658:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1788813000.328670:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1788813000.328678:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788813000.328680:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788813000.328903:0:8418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1788813000.328924:0:8418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1788813000.329111:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1788813000.329233:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1788813000.329253:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1788813000.329266:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1788813000.329276:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788813000.329277:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788813000.329552:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788813000.329671:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788813000.329690:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788813000.329705:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788813000.329731:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788813000.329733:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788813000.330208:0:8420:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1788813000.330233:0:8420:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1788813000.330246:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788813000.330381:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788813000.330397:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788813000.330412:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:0.0:1788813000.330427:0:6486:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788813000.330444:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003f84624f/0xf32533d6ff702755 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.330461:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a2092114/0xf32533d6ff70263d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702636 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.330479:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002911ae49/0xf32533d6ff7026b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7026ad expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.330486:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b79c582e/0xf32533d6ff7026ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7026e5 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.330491:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e4a925f8/0xf32533d6ff702708 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702701 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.330497:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70272b expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.330503:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003f84624f/0xf32533d6ff702755 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.330539:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff70272b expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.330553:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702732 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff70272b expref: 16 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813000.330577:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e036510a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313194240:0@lo:104: 00000100:00100000:0.0:1788813000.330636:0:6486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813000.330730:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e4a925f8/0xf32533d6ff702708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702701 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.330738:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e4a925f8/0xf32533d6ff702708 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702701 expref: 16 pid: 6488 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813000.330746:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f0ee7531 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313194368:0@lo:104: 00000100:00100000:0.0:1788813000.330766:0:6486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813000.330848:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b79c582e/0xf32533d6ff7026ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7026e5 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.330856:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b79c582e/0xf32533d6ff7026ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7026e5 expref: 16 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813000.330864:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092e47a53 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313194496:0@lo:104: 00000100:00100000:0.0:1788813000.330887:0:6486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813000.330947:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313194240 00000100:00100000:1.0:1788813000.330954:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313194240 00000100:00100000:1.0:1788813000.330987:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313194368 00000100:00100000:1.0:1788813000.330991:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313194368 00000100:00100000:1.0:1788813000.331005:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813000.331011:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b504df3c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6486:x1875706313194240:12345-0@lo:104: 00010000:00010000:1.0:1788813000.331024:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: 00000000a0af4f8d/0xf32533d6ff70272b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702732 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813000.331080:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813000.331085:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b504df3c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6486:x1875706313194240:12345-0@lo:104: Request processed in 74us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813000.331091:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813000.331107:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813000.331112:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000080c65014 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6486:x1875706313194368:12345-0@lo:104: 00010000:00010000:1.0:1788813000.331119:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff702701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702708 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813000.331157:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813000.331162:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000080c65014 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6486:x1875706313194368:12345-0@lo:104: Request processed in 50us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813000.331167:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1788813000.331233:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788813000.331239:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: 00000000a0af4f8d/0xf32533d6ff70272b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702732 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.331246:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a0af4f8d already unused, calling callback (00000000fec9925f) 10000000:00010000:2.0:1788813000.331249:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: 00000000a0af4f8d/0xf32533d6ff70272b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702732 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.331257:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: 00000000a0af4f8d/0xf32533d6ff70272b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702732 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813000.331263:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: 00000000a0af4f8d/0xf32533d6ff70272b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702732 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813000.331288:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788813000.331324:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: 00000000a0af4f8d/0xf32533d6ff70272b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702732 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.331331:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813000.331349:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: 00000000a0af4f8d/0xf32533d6ff70272b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702732 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.331356:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: 00000000a0af4f8d/0xf32533d6ff70272b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702732 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.331368:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813000.331371:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff702701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702708 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.331376:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fd7ccc00 already unused, calling callback (00000000fec9925f) 10000000:00010000:2.0:1788813000.331378:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff702701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702708 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.331384:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff702701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702708 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813000.331389:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff702701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702708 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813000.331394:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788813000.331406:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff702701 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702708 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.331413:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813000.331433:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff702701 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702708 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.331440:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: 00000000fd7ccc00/0xf32533d6ff702701 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702708 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.331450:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813000.331452:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813000.331453:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813000.331459:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813000.331483:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094a7f494 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313194624:0@lo:103: 00000100:00100000:2.0:1788813000.331512:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.331553:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f3e32975 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313194752:0@lo:103: 00000100:00100000:2.0:1788813000.331573:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.331600:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313194624 00000100:00100000:2.0:1788813000.331605:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313194624 00010000:00010000:2.0:1788813000.331623:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702732 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70272b expref: 17 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813000.331640:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313194752 00000100:00100000:2.0:1788813000.331643:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313194752 00010000:00010000:2.0:1788813000.331653:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e4a925f8/0xf32533d6ff702708 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702701 expref: 18 pid: 6488 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813000.331669:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813000.331675:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000d668baf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:3626:x1875706313194624:12345-0@lo:103: 00010000:00010000:2.0:1788813000.331685:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813000.331688:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702732 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70272b expref: 18 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.331706:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702732 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff70272b expref: 18 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.331719:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813000.331745:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000d668baf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:3626:x1875706313194624:12345-0@lo:103: Request processed in 72us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.331751:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813000.331765:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788813000.331770:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b86bff8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:3627:x1875706313194752:12345-0@lo:103: 00010000:00010000:2.0:1788813000.331777:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813000.331780:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e4a925f8/0xf32533d6ff702708 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702701 expref: 17 pid: 6488 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.331787:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e4a925f8/0xf32533d6ff702708 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702701 expref: 17 pid: 6488 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.331797:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813000.331819:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b86bff8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:3627:x1875706313194752:12345-0@lo:103: Request processed in 50us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.331825:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788813000.331863:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f3e32975 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313194752:0@lo:103: 00000100:00100000:2.0:1788813000.331885:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094a7f494 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313194624:0@lo:103: 00010000:00010000:0.0:1788813000.332124:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002911ae49/0xf32533d6ff7026b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7026ad expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.332133:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002911ae49/0xf32533d6ff7026b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7026ad expref: 16 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813000.332141:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000314e950e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313194880:0@lo:104: 00000100:00100000:0.0:1788813000.332165:0:6486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813000.332269:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a2092114/0xf32533d6ff70263d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702636 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.332286:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a2092114/0xf32533d6ff70263d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702636 expref: 16 pid: 6488 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813000.332294:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c13f13ad pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313195008:0@lo:104: 00000100:00100000:0.0:1788813000.332326:0:6486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813000.332364:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313194496 00000100:00100000:3.0:1788813000.332369:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313194496 00000100:00100000:3.0:1788813000.332392:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313194880 00000100:00100000:3.0:1788813000.332395:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313194880 00000100:00100000:3.0:1788813000.332407:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788813000.332412:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008583b577 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6486:x1875706313194496:12345-0@lo:104: 00010000:00010000:3.0:1788813000.332420:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: 000000002765ef56/0xf32533d6ff7026e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7026ec expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.332460:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813000.332464:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008583b577 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6486:x1875706313194496:12345-0@lo:104: Request processed in 52us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813000.332482:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788813000.332495:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813000.332501:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000770ba1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6486:x1875706313194880:12345-0@lo:104: 00010000:00010000:3.0:1788813000.332507:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: 000000003109aa10/0xf32533d6ff7026ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7026b4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.332543:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788813000.332548:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000770ba1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6486:x1875706313194880:12345-0@lo:104: Request processed in 48us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813000.332553:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788813000.332569:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813000.332574:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: 000000002765ef56/0xf32533d6ff7026e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7026ec expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.332580:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002765ef56 already unused, calling callback (00000000fec9925f) 10000000:00010000:3.0:1788813000.332588:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: 000000002765ef56/0xf32533d6ff7026e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7026ec expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.332594:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: 000000002765ef56/0xf32533d6ff7026e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7026ec expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813000.332599:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: 000000002765ef56/0xf32533d6ff7026e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7026ec expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813000.332605:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813000.332625:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: 000000002765ef56/0xf32533d6ff7026e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7026ec expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.332632:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813000.332641:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: 000000002765ef56/0xf32533d6ff7026e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7026ec expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.332646:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: 000000002765ef56/0xf32533d6ff7026e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7026ec expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.332656:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813000.332658:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: 000000003109aa10/0xf32533d6ff7026ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7026b4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.332662:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003109aa10 already unused, calling callback (00000000fec9925f) 10000000:00010000:3.0:1788813000.332664:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: 000000003109aa10/0xf32533d6ff7026ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7026b4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.332669:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: 000000003109aa10/0xf32533d6ff7026ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7026b4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813000.332683:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: 000000003109aa10/0xf32533d6ff7026ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7026b4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813000.332689:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813000.332700:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: 000000003109aa10/0xf32533d6ff7026ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7026b4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.332706:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813000.332714:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: 000000003109aa10/0xf32533d6ff7026ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7026b4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.332719:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: 000000003109aa10/0xf32533d6ff7026ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7026b4 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.332728:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813000.332730:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813000.332731:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813000.332792:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa8df672 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313195136:0@lo:103: 00000100:00100000:2.0:1788813000.332818:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.332854:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aea1808c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313195264:0@lo:103: 00000100:00100000:2.0:1788813000.332870:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.332893:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313195136 00000100:00100000:2.0:1788813000.332896:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313195136 00010000:00010000:2.0:1788813000.332906:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b79c582e/0xf32533d6ff7026ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7026e5 expref: 17 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813000.332917:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313195264 00000100:00100000:2.0:1788813000.332918:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313195264 00010000:00010000:2.0:1788813000.332922:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002911ae49/0xf32533d6ff7026b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7026ad expref: 18 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813000.332956:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813000.332960:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000094a7f494 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:3628:x1875706313195136:12345-0@lo:103: 00010000:00010000:2.0:1788813000.332967:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813000.332971:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b79c582e/0xf32533d6ff7026ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7026e5 expref: 18 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.332978:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b79c582e/0xf32533d6ff7026ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7026e5 expref: 18 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.332989:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813000.333013:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000094a7f494 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:3628:x1875706313195136:12345-0@lo:103: Request processed in 52us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.333018:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813000.333031:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813000.333037:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f3e32975 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:3625:x1875706313195264:12345-0@lo:103: 00010000:00010000:2.0:1788813000.333043:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813000.333046:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002911ae49/0xf32533d6ff7026b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7026ad expref: 17 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333054:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002911ae49/0xf32533d6ff7026b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7026ad expref: 17 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333068:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813000.333091:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f3e32975 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:3625:x1875706313195264:12345-0@lo:103: Request processed in 55us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.333095:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813000.333117:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aea1808c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313195264:0@lo:103: 00000100:00100000:2.0:1788813000.333129:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa8df672 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313195136:0@lo:103: 00010000:00010000:2.0:1788813000.333148:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813000.333350:0:6486:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f88af638 going to sleep for 11 seconds 00010000:00010000:0.0:1788813000.333363:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000222ef3b9/0xf32533d6ff702732 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff70272b expref: 16 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813000.333373:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e036510a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313194240:0@lo:104: 00010000:00010000:0.0:1788813000.333381:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e4a925f8/0xf32533d6ff702708 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702701 expref: 15 pid: 6488 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813000.333388:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f0ee7531 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313194368:0@lo:104: 00010000:00010000:0.0:1788813000.333395:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b79c582e/0xf32533d6ff7026ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7026e5 expref: 14 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813000.333402:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092e47a53 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313194496:0@lo:104: 00010000:00010000:0.0:1788813000.333409:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002911ae49/0xf32533d6ff7026b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7026ad expref: 13 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813000.333416:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000314e950e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313194880:0@lo:104: 00000100:00100000:3.0:1788813000.333450:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313195008 00000100:00100000:3.0:1788813000.333455:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313195008 00000100:00100000:3.0:1788813000.333514:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813000.333519:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ca2e1392 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6486:x1875706313195008:12345-0@lo:104: 00010000:00010000:3.0:1788813000.333526:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: 000000006fe79f37/0xf32533d6ff702636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70263d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.333577:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813000.333582:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ca2e1392 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6486:x1875706313195008:12345-0@lo:104: Request processed in 63us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813000.333587:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813000.333630:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c13f13ad pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6486:1875706313195008:0@lo:104: 00010000:00010000:0.0:1788813000.333645:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003f84624f/0xf32533d6ff702755 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333677:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813000.333680:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: 000000006fe79f37/0xf32533d6ff702636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70263d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333685:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006fe79f37 already unused, calling callback (00000000fec9925f) 10000000:00010000:2.0:1788813000.333686:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: 000000006fe79f37/0xf32533d6ff702636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff70263d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333690:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: 000000006fe79f37/0xf32533d6ff702636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff70263d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813000.333693:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: 000000006fe79f37/0xf32533d6ff702636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff70263d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813000.333696:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788813000.333716:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: 000000006fe79f37/0xf32533d6ff702636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70263d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333720:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813000.333727:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: 000000006fe79f37/0xf32533d6ff702636 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70263d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333738:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: 000000006fe79f37/0xf32533d6ff702636 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70263d expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333747:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813000.333748:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813000.333749:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813000.333753:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813000.333759:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000189bcb04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313195392:0@lo:103: 00000100:00100000:2.0:1788813000.333777:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.333792:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313195392 00000100:00100000:2.0:1788813000.333795:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313195392 00010000:00010000:2.0:1788813000.333806:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a2092114/0xf32533d6ff70263d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702636 expref: 13 pid: 6488 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813000.333824:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813000.333829:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000173b9be1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:3625:x1875706313195392:12345-0@lo:103: 00010000:00010000:2.0:1788813000.333837:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813000.333839:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a2092114/0xf32533d6ff70263d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702636 expref: 13 pid: 6488 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333847:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a2092114/0xf32533d6ff70263d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702636 expref: 13 pid: 6488 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333856:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a2092114/0xf32533d6ff70263d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702636 expref: 13 pid: 6488 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333866:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003f84624f/0xf32533d6ff702755 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333882:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003f84624f/0xf32533d6ff702755 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333895:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003f84624f/0xf32533d6ff702755 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333899:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003f84624f/0xf32533d6ff702755 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333903:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003f84624f/0xf32533d6ff702755 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333906:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003f84624f/0xf32533d6ff702755 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333908:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003f84624f already unused, calling callback (000000004f082eb1) 00010000:00010000:2.0:1788813000.333910:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003f84624f/0xf32533d6ff702755 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333914:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003f84624f/0xf32533d6ff702755 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333921:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003f84624f/0xf32533d6ff702755 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.333927:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813000.333965:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000173b9be1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:3625:x1875706313195392:12345-0@lo:103: Request processed in 137us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.333971:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813000.334015:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000189bcb04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313195392:0@lo:103: 00010000:00010000:2.0:1788813000.334032:0:6486:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003f84624f/0xf32533d6ff702755 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.334037:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003f84624f/0xf32533d6ff702755 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.334040:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003f84624f/0xf32533d6ff702755 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788813000.334048:0:6486:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788813000.336786:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000442fa57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:8398:x1875706313194112:12345-0@lo:253: Request processed in 11996us (12257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813000.336809:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788813000.336889:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025dc57ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313194112:0@lo:253: 10000000:01000000:3.0:1788813000.336910:0:8398:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788813000.336913:0:8398:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788813000.336914:0:8398:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788813000.336916:0:8398:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813000.336917:0:8398:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788813000.336918:0:8398:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813000.336919:0:8398:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813000.336921:0:8398:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813000.336922:0:8398:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788813000.336924:0:8398:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813000.336925:0:8398:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788813000.337069:0:8398:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000046db784c from lustre-OST0000 10000000:01000000:3.0:1788813000.337097:0:8398:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788813000.337100:0:8398:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788813000.337107:0:8398:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff948a506e4d40 local copy 10000000:01000000:3.0:1788813000.337110:0:8398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788813000.337138:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 00000000979502f7/0xf32533d6ff70275c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.337145:0:8398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.113@tcp lock: 00000000979502f7/0xf32533d6ff70275c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.337150:0:8398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 00000000979502f7/0xf32533d6ff70275c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813000.337162:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025dc57ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313195520:0@lo:101: 00000100:00100000:3.0:1788813000.337187:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813000.337244:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f8cadd6 going to sleep for 11 seconds 00000100:00100000:1.0:1788813000.337274:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313195520 00000100:00100000:1.0:1788813000.337279:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313195520 00000100:00100000:1.0:1788813000.337347:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788813000.337356:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e0f3f12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:8398:x1875706313195520:12345-0@lo:101: 00010000:00010000:1.0:1788813000.337368:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813000.337380:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000107f7a94/0xf32533d6ff702763 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70275c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813000.337400:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000107f7a94/0xf32533d6ff702763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70275c expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813000.337411:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000107f7a94/0xf32533d6ff702763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70275c expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813000.337418:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000107f7a94, rc 0) 00000100:00100000:1.0:1788813000.337456:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e0f3f12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:8398:x1875706313195520:12345-0@lo:101: Request processed in 102us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813000.337460:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788813000.337519:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025dc57ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313195520:0@lo:101: 00010000:00010000:3.0:1788813000.337529:0:8398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 00000000979502f7/0xf32533d6ff70275c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf32533d6ff702763 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.337548:0:8398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 00000000979502f7/0xf32533d6ff70275c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf32533d6ff702763 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813000.337632:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025dc57ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313195648:0@lo:501: 00000100:00100000:3.0:1788813000.337651:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813000.337666:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f8cadd6 going to sleep for 11 seconds 00000100:00100000:0.0:1788813000.337680:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313195648 00000100:00100000:0.0:1788813000.337685:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313195648 00000100:00100000:0.0:1788813000.337721:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788813000.337727:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000015fd7ea2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:8398:x1875706313195648:12345-0@lo:501: 00000100:00100000:3.0:1788813000.337829:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025dc57ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313195648:0@lo:501: 00000100:00100000:0.0:1788813000.337829:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000015fd7ea2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:8398:x1875706313195648:12345-0@lo:501: Request processed in 103us (177us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813000.337836:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 10000000:01000000:3.0:1788813000.337841:0:8398:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788813000.337856:0:8398:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788813000.337860:0:8398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 00000000979502f7/0xf32533d6ff70275c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf32533d6ff702763 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.337867:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 00000000979502f7/0xf32533d6ff70275c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf32533d6ff702763 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.337873:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: 00000000979502f7/0xf32533d6ff70275c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf32533d6ff702763 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.337889:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813000.337899:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813000.337903:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: 00000000979502f7/0xf32533d6ff70275c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf32533d6ff702763 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813000.337907:0:8398:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff948a7b74e800 00010000:00010000:0.0:1788813000.337910:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000979502f7 already unused, calling callback (00000000fec9925f) 10000000:01000000:3.0:1788813000.337912:0:8398:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:00010000:0.0:1788813000.337912:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: 00000000979502f7/0xf32533d6ff70275c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf32533d6ff702763 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813000.337916:0:8398:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788813000.337918:0:8398:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788813000.337920:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: 00000000979502f7/0xf32533d6ff70275c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf32533d6ff702763 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813000.337922:0:8398:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788813000.337924:0:8398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 10000000:00010000:0.0:1788813000.337927:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: 00000000979502f7/0xf32533d6ff70275c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf32533d6ff702763 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813000.337950:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813000.337978:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: 00000000979502f7/0xf32533d6ff70275c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf32533d6ff702763 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.337985:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813000.338003:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 000000005e82373a/0xf32533d6ff70276a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.338007:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: 00000000979502f7/0xf32533d6ff70275c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xf32533d6ff702763 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.338019:0:8398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 000000005e82373a/0xf32533d6ff70276a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.338020:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: 00000000979502f7/0xf32533d6ff70275c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xf32533d6ff702763 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.338026:0:8398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 000000005e82373a/0xf32533d6ff70276a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813000.338037:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025dc57ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313195904:0@lo:101: 00010000:00010000:0.0:1788813000.338037:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813000.338039:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813000.338040:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813000.338062:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.338107:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049cde2cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313195776:0@lo:103: 00000100:00100000:2.0:1788813000.338161:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.338195:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313195776 00000100:00100000:2.0:1788813000.338198:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313195776 00000100:00100000:2.0:1788813000.338225:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813000.338230:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000189bcb04 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:3627:x1875706313195776:12345-0@lo:103: 00010000:00010000:2.0:1788813000.338237:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813000.338246:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000107f7a94/0xf32533d6ff702763 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff70275c expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.338256:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813000.338276:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000189bcb04 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:3627:x1875706313195776:12345-0@lo:103: Request processed in 47us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.338281:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813000.338300:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049cde2cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313195776:0@lo:103: 00000100:00100000:3.0:1788813000.338339:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cafb3acf going to sleep for 11 seconds 00000100:00100000:0.0:1788813000.338341:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313195904 00000100:00100000:0.0:1788813000.338344:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313195904 00000100:00100000:0.0:1788813000.338370:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788813000.338377:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000651cfb12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:8398:x1875706313195904:12345-0@lo:101: 00010000:00010000:0.0:1788813000.338384:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813000.338393:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fd7ccc00/0xf32533d6ff702771 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70276a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.338405:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd7ccc00/0xf32533d6ff702771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70276a expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.338413:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fd7ccc00/0xf32533d6ff702771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70276a expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.338419:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fd7ccc00, rc 0) 00000100:00100000:0.0:1788813000.338458:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000651cfb12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:8398:x1875706313195904:12345-0@lo:101: Request processed in 82us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813000.338464:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788813000.338527:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025dc57ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313195904:0@lo:101: 00010000:00010000:3.0:1788813000.338538:0:8398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 000000005e82373a/0xf32533d6ff70276a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702771 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.338545:0:8398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 000000005e82373a/0xf32533d6ff70276a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702771 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813000.338593:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025dc57ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196032:0@lo:501: 00000100:00100000:3.0:1788813000.338613:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813000.338628:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cafb3acf going to sleep for 11 seconds 00000100:00100000:0.0:1788813000.338642:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313196032 00000100:00100000:0.0:1788813000.338646:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313196032 00000100:00100000:0.0:1788813000.338669:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788813000.338674:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000acd9f4fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:8398:x1875706313196032:12345-0@lo:501: 00000100:00100000:0.0:1788813000.338755:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000acd9f4fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:8398:x1875706313196032:12345-0@lo:501: Request processed in 81us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813000.338761:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788813000.338775:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025dc57ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196032:0@lo:501: 00000100:00100000:3.0:1788813000.338807:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025dc57ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196160:0@lo:503: 00000100:00100000:3.0:1788813000.338839:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813000.338856:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cafb3acf going to sleep for 11 seconds 00000100:00100000:0.0:1788813000.338867:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313196160 00000100:00100000:0.0:1788813000.338871:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313196160 00000100:00100000:0.0:1788813000.338897:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788813000.338902:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000015af4d5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:8398:x1875706313196160:12345-0@lo:503: 00000100:00100000:0.0:1788813000.338995:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000015af4d5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:8398:x1875706313196160:12345-0@lo:503: Request processed in 93us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813000.339002:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788813000.339022:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025dc57ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196160:0@lo:503: 00000040:00080000:1.0:1788813000.339238:0:8398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813000.339278:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004db0c2a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196288:0@lo:502: 00000100:00100000:1.0:1788813000.339303:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813000.339329:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set 00000000900e6d14 going to sleep for 11 seconds 00000100:00100000:0.0:1788813000.339337:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313196288 00000100:00100000:0.0:1788813000.339341:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313196288 00000100:00100000:0.0:1788813000.339370:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788813000.339376:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000019594701 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:8398:x1875706313196288:12345-0@lo:502: 00000100:00100000:0.0:1788813000.339437:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000019594701 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:8398:x1875706313196288:12345-0@lo:502: Request processed in 62us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813000.339444:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788813000.339458:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004db0c2a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196288:0@lo:502: 00000040:00080000:1.0:1788813000.339631:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788813000.339649:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788813000.339657:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788813000.339664:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788813000.339670:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788813000.339676:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788813000.339688:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004db0c2a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196416:0@lo:502: 00000100:00100000:1.0:1788813000.339710:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813000.339725:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set 000000008d7849ab going to sleep for 11 seconds 00000100:00100000:2.0:1788813000.339743:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313196416 00000100:00100000:2.0:1788813000.339747:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313196416 00000100:00100000:2.0:1788813000.339774:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788813000.339779:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000028831c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:8398:x1875706313196416:12345-0@lo:502: 00000100:00100000:2.0:1788813000.339851:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000028831c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:8398:x1875706313196416:12345-0@lo:502: Request processed in 72us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.339858:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788813000.339865:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004db0c2a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196416:0@lo:502: 00000040:00080000:1.0:1788813000.339895:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788813000.339902:0:8398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788813000.340283:0:8421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813000.340289:0:8421:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788813000.340294:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813000.340296:0:8421:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788813000.340300:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813000.340310:0:8421:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (0000000087d982a0) 00000020:00000080:1.0:1788813000.340325:0:8421:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788813000.340328:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788813000.340399:0:8421:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000046db784c from lustre-OST0000, refs=2 00080000:01000000:1.0:1788813000.340408:0:8421:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788813000.340414:0:8421:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf32533d6ff70277f 00010000:00010000:1.0:1788813000.346634:0:8421:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1788813000.348896:0:8421:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788813000.354042:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788813000.354379:0:8421:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788813000.357803:0:8421:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788813000.358128:0:8421:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788813000.361654:0:8421:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788813000.363060:0:8421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788813000.363069:0:8421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813000.363075:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813000.363076:0:8421:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788813000.363080:0:8421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813000.363082:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813000.363083:0:8421:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788813000.363085:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788813000.363086:0:8421:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788813000.363099:0:8421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813000.363101:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813000.363102:0:8421:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788813000.363103:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788813000.363164:0:8398:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788813000.363252:0:8398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788813000.363302:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: 000000005e82373a/0xf32533d6ff70276a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702771 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813000.363315:0:8398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: 000000005e82373a/0xf32533d6ff70276a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702771 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813000.363322:0:8398:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a7b74e800 from 1 10000000:01000000:1.0:1788813000.363325:0:8398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813000.363368:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff702786 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813000.363375:0:8398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff702786 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813000.363384:0:8398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff702786 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813000.363405:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004db0c2a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196544:0@lo:101: 00000100:00100000:1.0:1788813000.363465:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813000.363530:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc8f897b going to sleep for 11 seconds 00000100:00100000:2.0:1788813000.364755:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313196544 00000100:00100000:2.0:1788813000.364765:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313196544 00000100:00100000:2.0:1788813000.364815:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788813000.364823:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006f8834a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:8398:x1875706313196544:12345-0@lo:101: 00010000:00010000:2.0:1788813000.364837:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813000.364851:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4a925f8/0xf32533d6ff70278d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702786 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.364874:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4a925f8/0xf32533d6ff70278d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702786 expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.364883:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4a925f8/0xf32533d6ff70278d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702786 expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.364891:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4a925f8, rc 0) 00000100:00100000:2.0:1788813000.364970:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006f8834a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:8398:x1875706313196544:12345-0@lo:101: Request processed in 147us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.364977:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788813000.365228:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004db0c2a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196544:0@lo:101: 00010000:00010000:3.0:1788813000.365242:0:8398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff702786 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70278d expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.365256:0:8398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: 0000000093573cca/0xf32533d6ff702786 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70278d expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813000.365355:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3c0fa37 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196672:0@lo:501: 00000100:00100000:3.0:1788813000.365386:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813000.365410:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cafb3acf going to sleep for 11 seconds 00000100:00100000:2.0:1788813000.365524:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313196672 00000100:00100000:2.0:1788813000.365529:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313196672 00000100:00100000:2.0:1788813000.365554:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788813000.365561:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000583c8861 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:8398:x1875706313196672:12345-0@lo:501: 00000100:00100000:2.0:1788813000.365657:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000583c8861 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:8398:x1875706313196672:12345-0@lo:501: Request processed in 96us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.365663:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788813000.365722:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3c0fa37 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196672:0@lo:501: 00000100:00100000:1.0:1788813000.365751:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004db0c2a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196800:0@lo:503: 00000100:00100000:1.0:1788813000.365783:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813000.365799:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d70c7623 going to sleep for 11 seconds 00000100:00100000:2.0:1788813000.365817:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313196800 00000100:00100000:2.0:1788813000.365822:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313196800 00000100:00100000:2.0:1788813000.365851:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788813000.365857:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000392f115 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:8398:x1875706313196800:12345-0@lo:503: 00000100:00100000:2.0:1788813000.365968:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000392f115 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:8398:x1875706313196800:12345-0@lo:503: Request processed in 111us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.365974:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788813000.366029:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004db0c2a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196800:0@lo:503: 00000040:00080000:1.0:1788813000.366225:0:8398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813000.366268:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004db0c2a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196928:0@lo:502: 00000100:00100000:1.0:1788813000.366291:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813000.366312:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d70c7623 going to sleep for 11 seconds 00000100:00100000:3.0:1788813000.366323:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313196928 00000100:00100000:3.0:1788813000.366327:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313196928 00000100:00100000:3.0:1788813000.366355:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788813000.366362:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000ccdc294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:8398:x1875706313196928:12345-0@lo:502: 00000100:00100000:3.0:1788813000.366538:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000ccdc294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:8398:x1875706313196928:12345-0@lo:502: Request processed in 176us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813000.366545:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788813000.366581:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004db0c2a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313196928:0@lo:502: 00000040:00080000:3.0:1788813000.366807:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788813000.366832:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788813000.366851:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7cd9ad8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313197056:0@lo:502: 00000100:00100000:3.0:1788813000.366882:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813000.366956:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f8cadd6 going to sleep for 11 seconds 00000100:00100000:2.0:1788813000.367016:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313197056 00000100:00100000:2.0:1788813000.367021:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313197056 00000100:00100000:2.0:1788813000.367041:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788813000.367046:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002bb72aaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:8398:x1875706313197056:12345-0@lo:502: 00000100:00100000:2.0:1788813000.367152:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002bb72aaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:8398:x1875706313197056:12345-0@lo:502: Request processed in 106us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.367159:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788813000.367209:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7cd9ad8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313197056:0@lo:502: 00000040:00080000:3.0:1788813000.367242:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788813000.367249:0:8398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788813000.367703:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813000.367713:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813000.367715:0:8425:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788813000.367722:0:8425:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a7b74e800 00000020:00000080:1.0:1788813000.367724:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788813000.367804:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813000.367808:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813000.367810:0:8425:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788813000.367812:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788813000.368217:0:8398:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788813000.368239:0:8398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813000.368258:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff702786 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70278d expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.368276:0:8398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff702786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70278d expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813000.368319:0:8398:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788813000.368323:0:8398:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff948a7b74e800 10000000:01000000:2.0:1788813000.368325:0:8398:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff948a7b74e800 10000000:01000000:2.0:1788813000.368329:0:8398:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788813000.368334:0:8398:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a7b74e800 from 1 10000000:01000000:2.0:1788813000.368337:0:8398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788813000.368363:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff702794 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.368371:0:8398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff702794 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.368381:0:8398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff702794 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813000.368395:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64341500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313197184:0@lo:101: 00000100:00100000:2.0:1788813000.368511:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.368549:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a464153c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813000.368561:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313197184 00000100:00100000:1.0:1788813000.368567:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313197184 00000100:00100000:1.0:1788813000.368601:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788813000.368608:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:8398:x1875706313197184:12345-0@lo:101: 00010000:00010000:1.0:1788813000.368618:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813000.368628:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70279b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702794 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813000.368645:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70279b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702794 expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813000.368652:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70279b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702794 expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813000.368657:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166ec00, rc 0) 00000100:00100000:1.0:1788813000.368687:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:8398:x1875706313197184:12345-0@lo:101: Request processed in 80us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813000.368701:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788813000.368766:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64341500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313197184:0@lo:101: 00010000:00010000:2.0:1788813000.368778:0:8398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff702794 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70279b expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.368787:0:8398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff702794 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70279b expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813000.368857:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64341500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313197312:0@lo:501: 00000100:00100000:2.0:1788813000.368882:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.368903:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a464153c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813000.368947:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313197312 00000100:00100000:1.0:1788813000.368952:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313197312 00000100:00100000:1.0:1788813000.368976:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788813000.368982:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:8398:x1875706313197312:12345-0@lo:501: 00000100:00100000:1.0:1788813000.369062:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:8398:x1875706313197312:12345-0@lo:501: Request processed in 80us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813000.369069:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788813000.369082:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64341500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313197312:0@lo:501: 00000100:00100000:2.0:1788813000.369105:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64341500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313197440:0@lo:503: 00000100:00100000:2.0:1788813000.369137:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.369162:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a464153c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813000.369237:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313197440 00000100:00100000:1.0:1788813000.369240:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313197440 00000100:00100000:1.0:1788813000.369261:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788813000.369267:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:8398:x1875706313197440:12345-0@lo:503: 00000100:00100000:1.0:1788813000.369332:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:8398:x1875706313197440:12345-0@lo:503: Request processed in 64us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.369342:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64341500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313197440:0@lo:503: 00000100:00100000:1.0:1788813000.369349:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000040:00080000:2.0:1788813000.369610:0:8398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788813000.369665:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64341500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313197568:0@lo:502: 00000100:00100000:2.0:1788813000.369743:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.369760:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a464153c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813000.369877:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313197568 00000100:00100000:1.0:1788813000.369880:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313197568 00000100:00100000:1.0:1788813000.369902:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788813000.369908:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:8398:x1875706313197568:12345-0@lo:502: 00000100:00100000:1.0:1788813000.370003:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:8398:x1875706313197568:12345-0@lo:502: Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813000.370010:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788813000.370019:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64341500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313197568:0@lo:502: 00000040:00080000:2.0:1788813000.370191:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788813000.370216:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788813000.370231:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788813000.370245:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788813000.370256:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788813000.370267:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788813000.370278:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788813000.370289:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788813000.370300:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788813000.370312:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788813000.370322:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788813000.370333:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788813000.370346:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788813000.370370:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788813000.370384:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788813000.370397:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788813000.370409:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788813000.370420:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788813000.370506:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788813000.370527:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788813000.370541:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788813000.370555:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788813000.370566:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788813000.370578:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788813000.370589:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788813000.370612:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788813000.370623:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788813000.370633:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788813000.370642:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788813000.370651:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788813000.370661:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788813000.370670:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788813000.370680:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788813000.370689:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788813000.370795:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788813000.370808:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788813000.370819:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788813000.370839:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64341500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313197696:0@lo:502: 00000100:00100000:2.0:1788813000.370876:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.370907:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a464153c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813000.370928:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313197696 00000100:00100000:1.0:1788813000.370950:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313197696 00000100:00100000:1.0:1788813000.370979:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788813000.370986:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:8398:x1875706313197696:12345-0@lo:502: 00000100:00100000:1.0:1788813000.371059:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:8398:x1875706313197696:12345-0@lo:502: Request processed in 73us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813000.371066:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788813000.371081:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64341500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313197696:0@lo:502: 00000040:00080000:2.0:1788813000.371115:0:8398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788813000.371122:0:8398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788813000.371634:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788813000.371655:0:8426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9489420799c0) 00000020:00000080:0.0:1788813000.371677:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788813000.371754:0:8426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a7b74e800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788813000.371757:0:8426:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a7b74e800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788813000.371759:0:8426:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7b74e800 3 00010000:00080000:0.0:1788813000.371779:0:8426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a7ccaf000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.113@tcp at head 00010000:00010000:0.0:1788813000.373038:0:8426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1788813000.373189:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788813000.373219:0:8426:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788813000.373235:0:8426:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf32533d6ff7027a9 00000100:00080000:0.0:1788813000.373243:0:8426:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788813000.373251:0:8426:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff948a7ccaf000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813000.373281:0:8426:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489419b4380 x1875706313197824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813000.373309:0:8426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:1.0:1788813000.373661:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788813000.373672:0:8426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff948a506e19c0) 00000020:00000080:1.0:1788813000.373685:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788813000.373754:0:8426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a7b74e800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788813000.373758:0:8426:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a7b74e800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788813000.373761:0:8426:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7b74e800 3 00010000:00080000:1.0:1788813000.373783:0:8426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948942010800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813000.376132:0:8426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1788813000.376319:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788813000.376356:0:8426:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788813000.376367:0:8426:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf32533d6ff7027b7 00000100:00080000:1.0:1788813000.376376:0:8426:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813000.376386:0:8426:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff948942010800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813000.376420:0:8426:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a6a8f6a00 x1875706313198336/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813000.376432:0:8426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788813000.376556:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313197824:0@lo:38: 00000100:00100000:2.0:1788813000.376625:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.376664:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1875706313198336:0@lo:38: 00000100:00100000:2.0:1788813000.376686:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.376715:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813000.376723:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313197952:0@lo:400: 00000100:00100000:2.0:1788813000.376746:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.376772:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313198080:0@lo:400: 00000100:00100000:2.0:1788813000.376792:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.376803:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813000.376806:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313198208:0@lo:400: 00000100:00100000:2.0:1788813000.376841:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.376880:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313197824 00000100:00100000:2.0:1788813000.376886:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313197824 00000100:00100000:2.0:1788813000.376905:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313198336 00000100:00100000:2.0:1788813000.376908:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313198336 00000100:00100000:2.0:1788813000.376916:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313197952 00000100:00100000:2.0:1788813000.376919:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313197952 00000100:00100000:2.0:1788813000.376959:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313198080 00000100:00100000:2.0:1788813000.376962:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313198080 00000100:00100000:2.0:1788813000.376978:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813000.376986:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313197952:12345-0@lo:400: 00000100:00100000:2.0:1788813000.377040:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313197952:12345-0@lo:400: Request processed in 54us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.377047:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813000.377062:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813000.377067:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313198080:12345-0@lo:400: 00000040:00080000:0.0:1788813000.377071:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1788813000.377101:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313198080:12345-0@lo:400: Request processed in 32us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.377110:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813000.377123:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813000.377127:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313197824:12345-0@lo:38: 00010000:00080000:2.0:1788813000.377143:0:6496:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:2.0:1788813000.377179:0:6496:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf32533d6ff7027be 00000004:00100000:2.0:1788813000.377192:0:6496:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788813000.377224:0:6496:0:(import.c:65:import_set_state_nolock()) ffff948a6fbd6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813000.377259:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875706313197824:12345-0@lo:38: Request processed in 131us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.377265:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813000.377279:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788813000.377282:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313198336:12345-0@lo:38: 00010000:00080000:1.0:1788813000.377293:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9489419b4380 x1875706313197824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788813000.377295:0:6496:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000100:00100000:1.0:1788813000.377303:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813000.377310:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000020:00000080:2.0:1788813000.377314:0:6496:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf32533d6ff7027c5 00000100:00080000:1.0:1788813000.377316:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000004:00100000:2.0:1788813000.377319:0:6496:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788813000.377320:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788813000.377322:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7ccaf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788813000.377327:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313197824:0@lo:38: 00000100:00080000:2.0:1788813000.377333:0:6496:0:(import.c:65:import_set_state_nolock()) ffff948a6fbd0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813000.377363:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875706313198336:12345-0@lo:38: Request processed in 79us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.377369:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788813000.377374:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948a6a8f6a00 x1875706313198336/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813000.377381:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813000.377384:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788813000.377388:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788813000.377390:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788813000.377392:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948942010800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788813000.377393:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313198208 00000100:00100000:2.0:1788813000.377396:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313198208 00000100:00100000:1.0:1788813000.377396:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1875706313198336:0@lo:38: 00000100:00100000:2.0:1788813000.377419:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788813000.377425:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313198208:12345-0@lo:400: 00000100:00100000:2.0:1788813000.377453:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313198208:12345-0@lo:400: Request processed in 29us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813000.377465:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788813000.377520:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948a6a8f7100 x1875706313197952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813000.377529:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313197952:0@lo:400: 00000100:00100000:2.0:1788813000.377548:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313198208:0@lo:400: 00010000:00080000:2.0:1788813000.377557:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948a6a8f7480 x1875706313198080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813000.377565:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313198080:0@lo:400: 00000020:01000000:2.0:1788813000.377588:0:8398:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788813000.377616:0:8398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788813000.377632:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff702794 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70279b expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813000.377644:0:8398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff702794 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70279b expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788813000.377685:0:8398:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788813000.377687:0:8398:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788813000.377689:0:8398:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813000.377690:0:8398:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813000.377691:0:8398:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813000.377693:0:8398:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813000.377694:0:8398:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813000.377695:0:8398:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788813000.377697:0:8398:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788813000.377698:0:8398:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813000.377700:0:8398:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813000.377703:0:8398:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788813000.377705:0:8398:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788813000.377710:0:8398:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788813000.377711:0:8398:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813000.377712:0:8398:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813000.377713:0:8398:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813000.377714:0:8398:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813000.377715:0:8398:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813000.377716:0:8398:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788813000.377716:0:8398:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788813000.377717:0:8398:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813000.377718:0:8398:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813000.377733:0:8398:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788813000.377741:0:8398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64340700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313198464:0@lo:253: 00000100:00100000:2.0:1788813000.377771:0:8398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.377803:0:8398:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46415f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813000.378093:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313198464 00000100:00100000:1.0:1788813000.378098:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313198464 00000100:00100000:1.0:1788813000.378127:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788813000.378135:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:8398:x1875706313198464:12345-0@lo:253: 20000000:01000000:1.0:1788813000.378153:0:6488:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788813000.378166:0:6488:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788813000.382133:0:6488:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788813000.382149:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788813000.382164:0:6510:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788813000.382169:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788813000.382187:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a44cda600/0xf32533d6ff7027cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.382202:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a44cda000/0xf32533d6ff7026de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7026d7 expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.382208:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a821e4200/0xf32533d6ff7026fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7026f3 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.382213:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948a44cda600/0xf32533d6ff7027cc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.382242:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a821e4200/0xf32533d6ff7026fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7026f3 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.382253:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a821e4200/0xf32533d6ff7026fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7026f3 expref: 14 pid: 6488 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813000.382263:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6510:1875706313198592:0@lo:104: 00000100:00100000:0.0:1788813000.382317:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.382366:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:8398:x1875706313198464:12345-0@lo:253: Request processed in 4229us (4590us total) trans 0 rc 0/0 00010000:00010000:0.0:1788813000.382371:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a44cda000/0xf32533d6ff7026de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7026d7 expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813000.382381:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:0.0:1788813000.382389:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a44cda000/0xf32533d6ff7026de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7026d7 expref: 14 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813000.382397:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6510:1875706313198720:0@lo:104: 00000100:00100000:0.0:1788813000.382420:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46774540 going to sleep for 11 seconds 00000100:00100000:3.0:1788813000.382465:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788813000.382493:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813000.382511:0:8398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64340700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:8398:1875706313198464:0@lo:253: 00000100:00100000:3.0:1788813000.382521:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313198592 10000000:01000000:2.0:1788813000.382522:0:8398:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788813000.382524:0:8398:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000100:00100000:3.0:1788813000.382526:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313198592 00000020:01000004:2.0:1788813000.382526:0:8398:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788813000.382527:0:8398:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813000.382529:0:8398:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813000.382530:0:8398:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813000.382532:0:8398:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813000.382533:0:8398:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813000.382535:0:8398:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788813000.382537:0:8398:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788813000.382538:0:8398:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813000.382540:0:8398:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788813000.382548:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313198720 00000020:02000000:2.0:1788813000.382553:0:8398:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788813000.382555:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313198720 00000100:00100000:3.0:1788813000.382564:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788813000.382574:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fbce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6510:x1875706313198592:12345-0@lo:104: 00010000:00010000:3.0:1788813000.382586:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff7026f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7026fa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.382639:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813000.382645:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fbce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6510:x1875706313198592:12345-0@lo:104: Request processed in 74us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813000.382647:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6510:1875706313198592:0@lo:104: 00000100:00100000:3.0:1788813000.382658:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788813000.382692:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813000.382699:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6510:x1875706313198720:12345-0@lo:104: 00010000:00010000:3.0:1788813000.382706:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff7026d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7026de expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.382755:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788813000.382761:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6510:x1875706313198720:12345-0@lo:104: Request processed in 64us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813000.382768:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788813000.382791:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1788813000.382792:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6510:1875706313198720:0@lo:104: 00010000:00010000:3.0:1788813000.382799:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff7026f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7026fa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.382808:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948a44cda600/0xf32533d6ff7027cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.382810:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda800 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813000.382817:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff7026f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7026fa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.382828:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff7026f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7026fa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813000.382847:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff7026f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7026fa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813000.382853:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813000.382885:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff7026f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7026fa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.382892:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813000.382912:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff7026f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7026fa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.382920:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff7026f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7026fa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.382950:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813000.382954:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff7026d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7026de expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.382960:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4151c800 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813000.382962:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff7026d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7026de expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.382968:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff7026d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7026de expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813000.382975:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff7026d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7026de expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813000.382980:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813000.383005:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff7026d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7026de expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.383012:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813000.383018:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff7026d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7026de expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.383025:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff7026d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7026de expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.383039:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813000.383041:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813000.383043:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813000.383056:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313198976:0@lo:103: 00000100:00100000:3.0:1788813000.383082:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813000.383108:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813000.383115:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313198976 00000100:00100000:3.0:1788813000.383116:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313198848:0@lo:103: 00000100:00100000:0.0:1788813000.383122:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313198976 00010000:00010000:0.0:1788813000.383144:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a44cda000/0xf32533d6ff7026de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7026d7 expref: 14 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813000.383145:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813000.383171:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313198848 00000100:00100000:0.0:1788813000.383174:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313198848 00010000:00010000:0.0:1788813000.383188:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a821e4200/0xf32533d6ff7026fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7026f3 expref: 15 pid: 6488 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813000.383219:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813000.383226:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:3628:x1875706313198976:12345-0@lo:103: 00010000:00010000:0.0:1788813000.383236:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813000.383242:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a44cda000/0xf32533d6ff7026de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7026d7 expref: 15 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.383263:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a44cda000/0xf32533d6ff7026de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7026d7 expref: 15 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813000.383272:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788813000.383277:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cda000/0xf32533d6ff7026de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7026d7 expref: 15 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813000.383284:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:3628:x1875706313198848:12345-0@lo:103: 00010000:00010000:3.0:1788813000.383295:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813000.383295:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813000.383303:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a821e4200/0xf32533d6ff7026fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7026f3 expref: 14 pid: 6488 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.383314:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a821e4200/0xf32533d6ff7026fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7026f3 expref: 14 pid: 6488 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.383327:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e4200/0xf32533d6ff7026fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7026f3 expref: 14 pid: 6488 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813000.383333:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:3628:x1875706313198976:12345-0@lo:103: Request processed in 107us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813000.383343:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1788813000.383359:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948a44cda600/0xf32533d6ff7027cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.383368:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cda600/0xf32533d6ff7027cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788813000.383379:0:6480:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007561820s 00010000:00010000:3.0:1788813000.383384:0:6480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a44cda600/0xf32533d6ff7027cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.383391:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a44cda600/0xf32533d6ff7027cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.383398:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a44cda600/0xf32533d6ff7027cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.383405:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a44cda600/0xf32533d6ff7027cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.383410:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813000.383414:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a44cda600/0xf32533d6ff7027cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.383422:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a44cda600/0xf32533d6ff7027cc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.383436:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a44cda600/0xf32533d6ff7027cc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.383448:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813000.383448:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948a44cda600/0xf32533d6ff7027cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.383459:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a44cda600/0xf32533d6ff7027cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.383476:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cda600/0xf32533d6ff7027cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813000.383490:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:3628:x1875706313198848:12345-0@lo:103: Request processed in 210us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813000.383498:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813000.383526:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313198848:0@lo:103: 00000100:00100000:3.0:1788813000.383534:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313198976:0@lo:103: 00010000:00010000:3.0:1788813000.384987:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788813000.387917:0:8398:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788813000.388136:0:8398:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788813000.388278:0:8398:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788813000.388383:0:8398:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788813000.388551:0:8398:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788813000.388684:0:8398:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788813000.389656:0:8398:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788813000.395661:0:8398:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788813000.395670:0:8398:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788813000.395716:0:8398:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788813000.395777:0:8398:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788813000.395796:0:8398:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788813000.395811:0:8398:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788813000.396455:0:8398:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788813000.396646:0:8398:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788813000.549025:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788813000.907995:0:8482:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813000.908219:0:8482:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788813001.572221:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813002.596132:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788813003.364058:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788813003.364066:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a61047800 from 30 10000000:01000000:1.0:1788813003.364072:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788813003.364114:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff7027d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.364125:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff7027d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.364135:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff7027d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813003.364157:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313199104:0@lo:101: 00000100:00100000:1.0:1788813003.364218:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.364279:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a642316c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813003.364346:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313199104 00000100:00100000:2.0:1788813003.364353:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313199104 00000100:00100000:1.0:1788813003.364486:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788813003.364497:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6492:x1875706313199104:12345-0@lo:101: 00010000:00010000:1.0:1788813003.364510:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813003.364521:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a4166f600/0xf32533d6ff7027da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7027d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.364543:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a4166f600/0xf32533d6ff7027da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7027d3 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.364553:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a4166f600/0xf32533d6ff7027da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7027d3 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.364563:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f600, rc 0) 00000100:00100000:1.0:1788813003.364599:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:6492:x1875706313199104:12345-0@lo:101: Request processed in 104us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.364605:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788813003.364652:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313199104:0@lo:101: 00010000:00010000:1.0:1788813003.364667:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff7027d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7027da expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.364676:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff7027d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7027da expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813003.364728:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313199232:0@lo:501: 00000100:00100000:1.0:1788813003.364750:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.364765:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a642316c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813003.364807:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313199232 00000100:00100000:2.0:1788813003.364812:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313199232 00000100:00100000:2.0:1788813003.364838:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788813003.364845:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:6492:x1875706313199232:12345-0@lo:501: 00000100:00100000:2.0:1788813003.364972:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:6492:x1875706313199232:12345-0@lo:501: Request processed in 127us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813003.364979:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788813003.365055:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313199232:0@lo:501: 00000100:00100000:1.0:1788813003.365091:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313199360:0@lo:503: 00000100:00100000:1.0:1788813003.365129:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.365157:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a642316c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813003.365212:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313199360 00000100:00100000:2.0:1788813003.365216:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313199360 00000100:00100000:2.0:1788813003.365245:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788813003.365252:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:6492:x1875706313199360:12345-0@lo:503: 00000100:00100000:2.0:1788813003.365329:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:6492:x1875706313199360:12345-0@lo:503: Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813003.365336:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788813003.365426:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313199360:0@lo:503: 00000100:00100000:1.0:1788813003.365829:0:8716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8716:1875706313199488:0@lo:502: 00000100:00100000:1.0:1788813003.365863:0:8716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.365885:0:8716:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a642316c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813003.365957:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313199488 00000100:00100000:2.0:1788813003.365961:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313199488 00000100:00100000:2.0:1788813003.365982:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788813003.365988:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:8716:x1875706313199488:12345-0@lo:502: 00000100:00100000:2.0:1788813003.366064:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:8716:x1875706313199488:12345-0@lo:502: Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813003.366070:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788813003.366104:0:8716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8716:1875706313199488:0@lo:502: 00000100:00100000:2.0:1788813003.366142:0:8716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64340700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8716:1875706313199616:0@lo:502: 00000100:00100000:2.0:1788813003.366172:0:8716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813003.366191:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313199616 00000100:00100000:2.0:1788813003.366195:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313199616 00000100:00100000:2.0:1788813003.366216:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788813003.366221:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:8716:x1875706313199616:12345-0@lo:502: 00000100:00100000:2.0:1788813003.366273:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:8716:x1875706313199616:12345-0@lo:502: Request processed in 52us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813003.366279:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788813003.366306:0:8716:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6087eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813003.366318:0:8716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64340700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8716:1875706313199616:0@lo:502: 00000040:00080000:2.0:1788813003.366335:0:8716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788813003.366383:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788813003.366534:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788813003.366543:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff7027d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7027da expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813003.366552:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff7027d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7027da expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813003.366571:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788813003.366573:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a61047800 from 5 10000000:01000000:2.0:1788813003.366575:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788813003.366596:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5400/0xf32533d6ff7027e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813003.366604:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a821e5400/0xf32533d6ff7027e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813003.366612:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a821e5400/0xf32533d6ff7027e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813003.366624:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64340700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313199744:0@lo:101: 00000100:00100000:2.0:1788813003.366647:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813003.366676:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6087eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.366774:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313199744 00000100:00100000:1.0:1788813003.366778:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313199744 00000100:00100000:1.0:1788813003.366807:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788813003.366814:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:6492:x1875706313199744:12345-0@lo:101: 00010000:00010000:1.0:1788813003.366821:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813003.366832:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a4166f400/0xf32533d6ff7027e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7027e1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.366850:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a4166f400/0xf32533d6ff7027e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7027e1 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.366860:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a4166f400/0xf32533d6ff7027e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7027e1 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.366867:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f400, rc 0) 00000100:00100000:1.0:1788813003.366896:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:6492:x1875706313199744:12345-0@lo:101: Request processed in 84us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.366902:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788813003.366955:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64340700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313199744:0@lo:101: 00010000:00010000:1.0:1788813003.366968:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a821e5400/0xf32533d6ff7027e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7027e8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.366982:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a821e5400/0xf32533d6ff7027e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7027e8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813003.367022:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313199872:0@lo:256: 00000100:00100000:1.0:1788813003.367049:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.367061:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a484b7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.367072:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313199872 00000100:00100000:1.0:1788813003.367076:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313199872 00000100:00100000:1.0:1788813003.367097:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788813003.367104:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:6492:x1875706313199872:12345-0@lo:256: 20000000:01000000:1.0:1788813003.367115:0:6486:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788813003.367131:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788813003.367133:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788813003.367197:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:6492:x1875706313199872:12345-0@lo:256: Request processed in 94us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.367204:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788813003.367233:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313199872:0@lo:256: 10000000:01000000:1.0:1788813003.367270:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788813003.367275:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5400/0xf32533d6ff7027e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7027e8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.367282:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a821e5400/0xf32533d6ff7027e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7027e8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813003.367290:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788813003.367292:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1788813003.367295:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788813003.367314:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166f000/0xf32533d6ff7027ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.367321:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a4166f000/0xf32533d6ff7027ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.367329:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a4166f000/0xf32533d6ff7027ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813003.367340:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313200000:0@lo:101: 00000100:00100000:1.0:1788813003.367362:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.367374:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b4c93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.367384:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313200000 00000100:00100000:1.0:1788813003.367388:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313200000 00000100:00100000:1.0:1788813003.367492:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788813003.367500:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:6492:x1875706313200000:12345-0@lo:101: 00010000:00010000:1.0:1788813003.367506:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813003.367524:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff7027f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7027ef expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.367539:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff7027f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7027ef expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.367547:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff7027f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7027ef expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.367554:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9200, rc 0) 00000100:00100000:1.0:1788813003.367583:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313200000:12345-0@lo:101: Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.367588:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788813003.367624:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313200000:0@lo:101: 00010000:00010000:1.0:1788813003.367634:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a4166f000/0xf32533d6ff7027ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7027f6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.367641:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a4166f000/0xf32533d6ff7027ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7027f6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813003.367682:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313200128:0@lo:501: 00000100:00100000:1.0:1788813003.367705:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.367716:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b4c93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.367725:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313200128 00000100:00100000:1.0:1788813003.367728:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313200128 00000100:00100000:1.0:1788813003.367746:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788813003.367752:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313200128:12345-0@lo:501: 00000100:00100000:1.0:1788813003.367850:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313200128:12345-0@lo:501: Request processed in 97us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.367856:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788813003.367883:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313200128:0@lo:501: 00000100:00100000:1.0:1788813003.367905:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313200256:0@lo:503: 00000100:00100000:1.0:1788813003.367956:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.367968:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b4c93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.367979:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313200256 00000100:00100000:1.0:1788813003.367982:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313200256 00000100:00100000:1.0:1788813003.368000:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788813003.368005:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313200256:12345-0@lo:503: 00000100:00100000:1.0:1788813003.368072:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313200256:12345-0@lo:503: Request processed in 66us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.368085:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788813003.368119:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313200256:0@lo:503: 00000100:00100000:1.0:1788813003.368278:0:8717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8717:1875706313200384:0@lo:502: 00000100:00100000:1.0:1788813003.368308:0:8717:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.368325:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313200384 00000100:00100000:1.0:1788813003.368329:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313200384 00000100:00100000:1.0:1788813003.368351:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788813003.368356:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:8717:x1875706313200384:12345-0@lo:502: 00000100:00100000:1.0:1788813003.368587:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:8717:x1875706313200384:12345-0@lo:502: Request processed in 230us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.368594:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788813003.368622:0:8717:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a484b7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.368633:0:8717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8717:1875706313200384:0@lo:502: 00000020:01000000:1.0:1788813003.368653:0:8717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813003.368659:0:8717:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788813003.368665:0:8717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813003.368668:0:8717:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788813003.368673:0:8717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788813003.368677:0:8717:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:01000000:1.0:1788813003.368696:0:8717:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788813003.368698:0:8717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813003.368712:0:8717:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff948a506e3380) 00000020:00000080:1.0:1788813003.368732:0:8717:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788813003.368738:0:8717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788813003.368820:0:8717:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788813003.368827:0:8717:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788813003.368840:0:8717:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff702804 00010000:00080000:1.0:1788813003.368874:0:8717:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948942c27800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813003.369262:0:8717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788813003.379916:0:8717:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788813003.379975:0:8717:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788813003.380177:0:8717:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813003.380376:0:8717:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813003.380470:0:8717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788813003.380548:0:8717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788813003.381057:0:8718:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788813003.381063:0:8718:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788813003.381906:0:8717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788813003.381917:0:8717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788813003.381972:0:8717:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788813003.381995:0:8717:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff70280b 00000100:00080000:1.0:1788813003.382005:0:8717:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813003.382016:0:8717:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff948942c27800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813003.382048:0:8717:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a6a8f6d80 x1875706313200512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813003.382110:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313200512:0@lo:8: 00000100:00100000:0.0:1788813003.382176:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.382248:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313200512 00000100:00100000:1.0:1788813003.382255:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313200512 00000100:00100000:1.0:1788813003.382281:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813003.382288:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1875706313200512:12345-0@lo:8: 00010000:00080000:1.0:1788813003.382311:0:8403:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:1.0:1788813003.382335:0:8403:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff702812 00002000:00100000:1.0:1788813003.382361:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff948942c23000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788813003.382365:0:8403:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1788813003.382368:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788813003.382418:0:8403:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788813003.382602:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788813003.382641:0:8403:0:(import.c:65:import_set_state_nolock()) ffff948942c25800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813003.382808:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1875706313200512:12345-0@lo:8: Request processed in 518us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.382816:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788813003.382838:0:8717:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788813003.382989:0:8717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813003.382994:0:8717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813003.382996:0:8717:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788813003.382999:0:8717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813003.383003:0:8717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813003.383004:0:8717:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788813003.383007:0:8717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788813003.383009:0:8717:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788813003.383012:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313200896:0@lo:400: 00000100:00100000:1.0:1788813003.383027:0:8717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8717:1875706313201408:0@lo:502: 00000100:00100000:3.0:1788813003.383042:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.383063:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813003.383063:0:8717:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.383068:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313201024:0@lo:400: 00000100:00100000:1.0:1788813003.383079:0:8717:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46897900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813003.383087:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.383101:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313201024 00000100:00100000:1.0:1788813003.383104:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313201024 00000100:00100000:1.0:1788813003.383130:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788813003.383137:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313201024:12345-0@lo:400: 00000100:00100000:1.0:1788813003.383173:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313201024:12345-0@lo:400: Request processed in 36us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.383179:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788813003.383208:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313201024:0@lo:400: 00010000:00080000:0.0:1788813003.383280:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6a8f6d80 x1875706313200512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813003.383289:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788813003.383295:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788813003.383301:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788813003.383306:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788813003.383313:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948942c27800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788813003.383326:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788813003.383331:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313200512:0@lo:8: 00000100:00100000:0.0:1788813003.383362:0:8719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8719:1875706313201536:0@lo:700: 00000100:00100000:0.0:1788813003.383386:0:8719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813003.383398:0:8719:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a471c39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.383464:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313201536 00000100:00100000:1.0:1788813003.383469:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313201536 00000100:00100000:2.0:1788813003.383528:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313200640:0@lo:400: 00000100:00100000:1.0:1788813003.383534:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813003.383546:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8719:x1875706313201536:12345-0@lo:700: 00000100:00100000:2.0:1788813003.383555:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.383570:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8413:1875706313201664:0@lo:700: 00000100:00100000:2.0:1788813003.383572:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313201152:0@lo:400: 00000100:00100000:2.0:1788813003.383588:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.383591:0:8413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.383601:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46897180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813003.383602:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788813003.383607:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313200768:0@lo:400: 00000100:00100000:2.0:1788813003.383628:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.383633:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313201664 00000100:00100000:1.0:1788813003.383636:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313201664 00000100:00100000:2.0:1788813003.383643:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313201280:0@lo:400: 00000100:00100000:2.0:1788813003.383661:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813003.383682:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313200896 00000100:00100000:2.0:1788813003.383686:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313200896 00000100:00100000:2.0:1788813003.383710:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313200640 00000100:00100000:2.0:1788813003.383719:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313200640 00000100:00100000:2.0:1788813003.383734:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313201152 00000100:00100000:2.0:1788813003.383736:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313201152 00000100:00100000:2.0:1788813003.383746:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313201280 00000100:00100000:2.0:1788813003.383748:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313201280 00000100:00080000:0.0:1788813003.383828:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788813003.383833:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813003.383834:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813003.383998:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813003.384005:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+6:8413:x1875706313201664:12345-0@lo:700: 00000004:00080000:1.0:1788813003.384099:0:8718:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788813003.384154:0:8718:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 156403222076ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788813003.384161:0:8718:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788813003.388692:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813003.388707:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313200896:12345-0@lo:400: 00000100:00100000:2.0:1788813003.388799:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313200896:12345-0@lo:400: Request processed in 97us (5757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813003.388807:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813003.388825:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813003.388832:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313200640:12345-0@lo:400: 00000100:00100000:2.0:1788813003.388866:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313200640:12345-0@lo:400: Request processed in 35us (5309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813003.388871:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813003.388883:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788813003.388889:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3625:x1875706313201152:12345-0@lo:400: 00000100:00100000:2.0:1788813003.388915:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3625:x1875706313201152:12345-0@lo:400: Request processed in 27us (5326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813003.388922:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788813003.388948:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813003.388955:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313201280:12345-0@lo:400: 00000100:00100000:2.0:1788813003.388983:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313201280:12345-0@lo:400: Request processed in 30us (5322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813003.388994:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813003.389018:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313201408 00000100:00100000:2.0:1788813003.389025:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313201408 00000100:00100000:2.0:1788813003.389061:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788813003.389068:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:8717:x1875706313201408:12345-0@lo:502: 00000100:00100000:2.0:1788813003.389182:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:8717:x1875706313201408:12345-0@lo:502: Request processed in 114us (6118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813003.389189:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788813003.389227:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313200768 00000100:00100000:2.0:1788813003.389231:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313200768 00000100:00100000:2.0:1788813003.389249:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813003.389254:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313200768:12345-0@lo:400: 00000100:00100000:2.0:1788813003.389286:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313200768:12345-0@lo:400: Request processed in 31us (5656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813003.389292:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788813003.389346:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6eb01180 x1875706313200896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813003.389360:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313200896:0@lo:400: 00000100:00100000:2.0:1788813003.389398:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313200768:0@lo:400: 00010000:00080000:2.0:1788813003.389649:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6eb03100 x1875706313201280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813003.389661:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313201280:0@lo:400: 00010000:00080000:2.0:1788813003.389673:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6eb02d80 x1875706313200640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813003.389681:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313200640:0@lo:400: 00010000:00080000:2.0:1788813003.389692:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6eb01500 x1875706313201152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813003.389712:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313201152:0@lo:400: 00000100:00100000:2.0:1788813003.389746:0:8717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8717:1875706313201408:0@lo:502: 00000020:01000000:2.0:1788813003.389774:0:8717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813003.389781:0:8717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813003.389783:0:8717:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788813003.389787:0:8717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1788813003.389849:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1788813003.389878:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788813003.389888:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166f000/0xf32533d6ff7027ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7027f6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813003.389900:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4166f000/0xf32533d6ff7027ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7027f6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813003.389910:0:6492:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813003.389912:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a61047800 from 1 10000000:01000000:2.0:1788813003.389915:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813003.389972:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff702819 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813003.389980:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff702819 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813003.389990:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff702819 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813003.390007:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64341f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313201792:0@lo:101: 00000100:00100000:2.0:1788813003.390040:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813003.390077:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6087eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813003.390091:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313201792 00000100:00100000:2.0:1788813003.390094:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313201792 00000100:00100000:2.0:1788813003.390120:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788813003.390127:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313201792:12345-0@lo:101: 00010000:00010000:2.0:1788813003.390136:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813003.390147:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a821e4a00/0xf32533d6ff702820 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702819 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813003.390167:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e4a00/0xf32533d6ff702820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702819 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813003.390178:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a821e4a00/0xf32533d6ff702820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702819 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813003.390187:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4a00, rc 0) 40000000:02000000:3.0:1788813003.390733:0:6501:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1788813003.391098:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313201792:12345-0@lo:101: Request processed in 89us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813003.391108:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788813003.391160:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64341f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313201792:0@lo:101: 00010000:00010000:2.0:1788813003.391176:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff702819 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702820 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813003.391183:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff702819 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702820 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813003.391225:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64341f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313201920:0@lo:501: 00000100:00100000:2.0:1788813003.391246:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813003.391266:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6087eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.391359:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313201920 00000100:00100000:1.0:1788813003.391363:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313201920 00000100:00100000:1.0:1788813003.391388:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788813003.391393:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313201920:12345-0@lo:501: 00000100:00100000:1.0:1788813003.391731:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313201920:12345-0@lo:501: Request processed in 336us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.391738:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788813003.394506:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64341f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313201920:0@lo:501: 00000100:00100000:0.0:1788813003.394604:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313202048:0@lo:503: 00000100:00100000:0.0:1788813003.394667:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813003.394691:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788813003.394709:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313202048 00000100:00100000:0.0:1788813003.394714:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313202048 00000100:00100000:0.0:1788813003.394756:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788813003.394765:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313202048:12345-0@lo:503: 00000100:00100000:0.0:1788813003.394866:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313202048:12345-0@lo:503: Request processed in 101us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813003.394872:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788813003.394917:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313202048:0@lo:503: 00000100:00100000:0.0:1788813003.395357:0:8720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8720:1875706313202176:0@lo:502: 00000100:00100000:0.0:1788813003.395392:0:8720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813003.395421:0:8720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.395476:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313202176 00000100:00100000:1.0:1788813003.395481:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313202176 00000100:00100000:1.0:1788813003.395512:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788813003.395520:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:8720:x1875706313202176:12345-0@lo:502: 00000100:00100000:1.0:1788813003.395594:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:8720:x1875706313202176:12345-0@lo:502: Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.395601:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788813003.395670:0:8720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8720:1875706313202176:0@lo:502: 00000020:01000000:0.0:1788813003.395691:0:8720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813003.395704:0:8720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813003.395706:0:8720:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788813003.395714:0:8720:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a61047800 00000020:00000080:0.0:1788813003.395716:0:8720:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788813003.395737:0:8720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8720:1875706313202304:0@lo:502: 00000100:00100000:0.0:1788813003.395768:0:8720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813003.395789:0:8720:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.395835:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313202304 00000100:00100000:1.0:1788813003.395839:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313202304 00000100:00100000:1.0:1788813003.395873:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788813003.395879:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:8720:x1875706313202304:12345-0@lo:502: 00000100:00100000:1.0:1788813003.395960:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:8720:x1875706313202304:12345-0@lo:502: Request processed in 80us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.395966:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788813003.396037:0:8720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8720:1875706313202304:0@lo:502: 00000020:01000000:0.0:1788813003.396054:0:8720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813003.396058:0:8720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813003.396060:0:8720:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788813003.396063:0:8720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788813003.396170:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788813003.396192:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813003.396201:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff702819 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702820 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.396212:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff702819 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702820 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813003.396221:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788813003.396224:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a60186000 from 30 10000000:01000000:1.0:1788813003.396227:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788813003.396250:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff702827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.396259:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff702827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.396268:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff702827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813003.396281:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313202432:0@lo:101: 00000100:00100000:1.0:1788813003.396308:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.396330:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4843da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813003.396367:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313202432 00000100:00100000:0.0:1788813003.396371:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313202432 00000100:00100000:0.0:1788813003.396399:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788813003.396405:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313202432:12345-0@lo:101: 00010000:00010000:0.0:1788813003.396413:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813003.396425:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70282e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702827 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.396453:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70282e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702827 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.396464:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70282e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702827 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.396473:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdaa00, rc 0) 00000100:00100000:0.0:1788813003.396500:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313202432:12345-0@lo:101: Request processed in 95us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813003.396506:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788813003.396571:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313202432:0@lo:101: 00010000:00010000:1.0:1788813003.396590:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff702827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70282e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813003.396599:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff702827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70282e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813003.396638:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313202560:0@lo:501: 00000100:00100000:1.0:1788813003.396663:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.396681:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4843da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813003.396716:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313202560 00000100:00100000:0.0:1788813003.396720:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313202560 00000004:00080000:2.0:1788813003.396866:0:7425:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788813003.396917:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788813003.396924:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313202560:12345-0@lo:501: 00000100:00100000:0.0:1788813003.397041:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313202560:12345-0@lo:501: Request processed in 117us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813003.397047:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788813003.397103:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313202560:0@lo:501: 00000100:00100000:2.0:1788813003.397126:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64342300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313202688:0@lo:503: 00000100:00100000:3.0:1788813003.397128:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8413:x1875706313201664:12345-0@lo:700: Request processed in 13122us (13534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813003.397140:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813003.397158:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788813003.397172:0:8413:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6a8f6d80 x1875706313201664/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788813019 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813003.397184:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8413:1875706313201664:0@lo:700: 40000000:02000000:3.0:1788813003.397192:0:8413:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:2.0:1788813003.397290:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6087eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.397328:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313202688 00000100:00100000:1.0:1788813003.397333:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313202688 00000100:00100000:1.0:1788813003.397353:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788813003.397359:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313202688:12345-0@lo:503: 00000100:00100000:1.0:1788813003.397425:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313202688:12345-0@lo:503: Request processed in 66us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.397432:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788813003.397545:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64342300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313202688:0@lo:503: 00000100:00100000:0.0:1788813003.397823:0:8721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8721:1875706313202816:0@lo:502: 00000100:00100000:0.0:1788813003.397855:0:8721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813003.397902:0:8721:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.397929:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313202816 00000001:00100000:3.0:1788813003.403429:0:8399:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788813003.403548:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8719:x1875706313201536:12345-0@lo:700: Request processed in 19998us (20157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813003.403563:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813003.403758:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313202816 00010000:00080000:3.0:1788813003.403762:0:8719:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489419b5180 x1875706313201536/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788813019 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813003.403777:0:8719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8719:1875706313201536:0@lo:700: 00000100:00100000:1.0:1788813003.403807:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788813003.403815:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:8721:x1875706313202816:12345-0@lo:502: 00000100:00100000:1.0:1788813003.403923:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:8721:x1875706313202816:12345-0@lo:502: Request processed in 108us (6066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.403946:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788813003.405842:0:8721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8721:1875706313202816:0@lo:502: 00000100:00100000:0.0:1788813003.405914:0:8721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8721:1875706313202944:0@lo:502: 00000100:00100000:0.0:1788813003.405993:0:8721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813003.406027:0:8721:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.406083:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313202944 00000100:00100000:1.0:1788813003.406089:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313202944 00000100:00100000:1.0:1788813003.406151:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788813003.406158:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:8721:x1875706313202944:12345-0@lo:502: 00000100:00100000:1.0:1788813003.406236:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:8721:x1875706313202944:12345-0@lo:502: Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.406241:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788813003.409566:0:8721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8721:1875706313202944:0@lo:502: 00000040:00080000:0.0:1788813003.409611:0:8721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788813003.409771:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788813003.409800:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788813003.409811:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff702827 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70282e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813003.409822:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff702827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70282e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813003.409832:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788813003.409836:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a60186000 from 5 10000000:01000000:3.0:1788813003.409839:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788813003.409883:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151c200/0xf32533d6ff702835 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813003.409891:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a4151c200/0xf32533d6ff702835 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813003.409901:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a4151c200/0xf32533d6ff702835 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813003.409919:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313203072:0@lo:101: 00000100:00100000:3.0:1788813003.409995:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.410033:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489422569c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813003.410215:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313203072 00000100:00100000:0.0:1788813003.410222:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313203072 00000100:00100000:0.0:1788813003.410262:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788813003.410270:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313203072:12345-0@lo:101: 00010000:00010000:0.0:1788813003.410283:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813003.410296:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cda800/0xf32533d6ff70283c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702835 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.410318:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cda800/0xf32533d6ff70283c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702835 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.410341:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cda800/0xf32533d6ff70283c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702835 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.410350:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cda800, rc 0) 00000100:00100000:0.0:1788813003.410386:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313203072:12345-0@lo:101: Request processed in 116us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813003.410392:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788813003.410434:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313203072:0@lo:101: 00000004:00080000:3.0:1788813003.410457:0:8719:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00010000:00010000:0.0:1788813003.410458:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a4151c200/0xf32533d6ff702835 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70283c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.410467:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a4151c200/0xf32533d6ff702835 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70283c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813003.410474:0:8719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8719:1875706313203328:0@lo:7: 00000100:00100000:3.0:1788813003.410499:0:8719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813003.410503:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313203456:0@lo:256: 00000100:00100000:3.0:1788813003.410522:0:8719:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813003.410528:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.410534:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813003.410539:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813003.410542:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313203200:0@lo:13: 00000100:00100000:0.0:1788813003.410549:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313203456 00000100:00100000:0.0:1788813003.410552:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313203456 00000100:00100000:3.0:1788813003.410564:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813003.410570:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788813003.410576:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313203456:12345-0@lo:256: 20000000:01000000:0.0:1788813003.410588:0:6486:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788813003.410609:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788813003.410615:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788813003.410679:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313203456:12345-0@lo:256: Request processed in 103us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813003.410686:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788813003.410726:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313203456:0@lo:256: 10000000:01000000:0.0:1788813003.410762:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788813003.410767:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151c200/0xf32533d6ff702835 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70283c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.410774:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4151c200/0xf32533d6ff702835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70283c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813003.410780:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788813003.410782:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788813003.410783:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788813003.410795:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff702843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.410801:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff702843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.410807:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff702843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813003.410816:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313203584:0@lo:101: 00000100:00100000:0.0:1788813003.410835:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813003.410845:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813003.410855:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313203584 00000100:00100000:0.0:1788813003.410858:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313203584 00000100:00100000:0.0:1788813003.410876:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788813003.410882:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313203584:12345-0@lo:101: 00010000:00010000:0.0:1788813003.410888:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813003.410895:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cda000/0xf32533d6ff70284a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702843 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813003.411604:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313203200 00010000:00010000:0.0:1788813003.411652:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cda000/0xf32533d6ff70284a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702843 expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.411661:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cda000/0xf32533d6ff70284a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702843 expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.411668:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cda000, rc 0) 00000100:00100000:0.0:1788813003.411713:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313203584:12345-0@lo:101: Request processed in 831us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813003.411720:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788813003.411747:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313203200 00000100:00100000:3.0:1788813003.411784:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813003.411791:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313203200:12345-0@lo:13: 00000100:00100000:1.0:1788813003.411792:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313203584:0@lo:101: 00010000:00010000:1.0:1788813003.411805:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff702843 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70284a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:3.0:1788813003.411811:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00010000:00010000:1.0:1788813003.411813:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff702843 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70284a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813003.411869:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313203712:0@lo:501: 00010000:00080000:0.0:1788813003.414084:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6eb02d80 x1875706313203200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813003.414106:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313203200:0@lo:13: 00000100:00100000:0.0:1788813003.414151:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313203328 00000100:00100000:0.0:1788813003.414157:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313203328 00000100:00100000:0.0:1788813003.414193:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813003.414199:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8719:x1875706313203328:12345-0@lo:7: 00000100:00100000:3.0:1788813003.417022:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3628:x1875706313203200:12345-0@lo:13: Request processed in 5222us (6447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.417032:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.417036:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813003.417067:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4843d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.417088:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313203712 00000100:00100000:1.0:1788813003.417095:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313203712 00000100:00100000:1.0:1788813003.417143:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788813003.417152:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313203712:12345-0@lo:501: 00000100:00100000:1.0:1788813003.417268:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313203712:12345-0@lo:501: Request processed in 117us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.417275:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788813003.417302:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313203712:0@lo:501: 00000100:00100000:3.0:1788813003.417352:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313203840:0@lo:503: 00000100:00100000:3.0:1788813003.417391:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.417497:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489422569c0 going to sleep for 11 seconds 00002000:00080000:0.0:1788813003.418245:0:8405:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788813003.418251:0:8405:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788813003.418302:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8719:x1875706313203328:12345-0@lo:7: Request processed in 4101us (7801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813003.418310:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788813003.418314:0:8719:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6eb03100 x1875706313203328/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788813019 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813003.418326:0:8719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8719:1875706313203328:0@lo:7: 00000004:00080000:3.0:1788813003.418336:0:8719:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788813003.418357:0:8719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8719:1875706313203968:0@lo:5: 00000100:00100000:3.0:1788813003.418382:0:8719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.418415:0:8719:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.418713:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313203840 00000100:00100000:1.0:1788813003.418719:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313203840 00000100:00100000:1.0:1788813003.418763:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788813003.418772:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313203840:12345-0@lo:503: 00000100:00100000:1.0:1788813003.418861:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313203840:12345-0@lo:503: Request processed in 90us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.418868:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788813003.418911:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313203840:0@lo:503: 00000100:00100000:0.0:1788813003.419008:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313203968 00000100:00100000:0.0:1788813003.419012:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313203968 00000100:00100000:0.0:1788813003.419043:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813003.419050:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8719:x1875706313203968:12345-0@lo:5: 00002000:00080000:0.0:1788813003.419069:0:8404:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788813003.419107:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8719:x1875706313203968:12345-0@lo:5: Request processed in 57us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813003.419113:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788813003.419127:0:8719:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6eb03100 x1875706313203968/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813019 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813003.419137:0:8719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8719:1875706313203968:0@lo:5: 00000004:00080000:3.0:1788813003.419151:0:8719:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788813003.419174:0:8719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8719:1875706313204096:0@lo:5: 00000100:00100000:3.0:1788813003.419197:0:8719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.419210:0:8719:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.419236:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313204096 00000100:00100000:1.0:1788813003.419240:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313204096 00000100:00100000:1.0:1788813003.419264:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813003.419271:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8719:x1875706313204096:12345-0@lo:5: 00002000:00080000:1.0:1788813003.419288:0:8405:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788813003.420288:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8719:x1875706313204096:12345-0@lo:5: Request processed in 1015us (1087us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788813003.420297:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788813003.420315:0:8719:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6eb03100 x1875706313204096/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813019 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813003.420327:0:8719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8719:1875706313204096:0@lo:5: 00000004:00080000:3.0:1788813003.420337:0:8719:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1788813003.420370:0:8719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb02300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8719:1875706313204224:0@lo:900: 00000100:00100000:1.0:1788813003.420375:0:8724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8724:1875706313204352:0@lo:502: 00000100:00100000:3.0:1788813003.420395:0:8719:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813003.420406:0:8724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.420423:0:8719:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.420429:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313204352 00000100:00100000:1.0:1788813003.420433:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313204352 00000100:00100000:3.0:1788813003.420436:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313204224 00000100:00100000:3.0:1788813003.420450:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313204224 00000100:00100000:3.0:1788813003.420473:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813003.420473:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788813003.420480:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8719:x1875706313204224:12345-0@lo:900: 00000100:00100000:1.0:1788813003.420480:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:8724:x1875706313204352:12345-0@lo:502: 00000100:00100000:3.0:1788813003.420520:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8719:x1875706313204224:12345-0@lo:900: Request processed in 41us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813003.420526:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788813003.420554:0:8719:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6eb02300 x1875706313204224/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788813019 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813003.420563:0:8719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb02300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8719:1875706313204224:0@lo:900: 00000100:00100000:1.0:1788813003.420563:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:8724:x1875706313204352:12345-0@lo:502: Request processed in 84us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.420569:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788813003.420608:0:8724:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6eb2d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.420620:0:8724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8724:1875706313204352:0@lo:502: 00000020:01000000:1.0:1788813003.420640:0:8724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813003.420645:0:8724:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788813003.420652:0:8724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813003.420654:0:8724:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788813003.420659:0:8724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788813003.420662:0:8724:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:01000000:1.0:1788813003.420679:0:8724:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788813003.420685:0:8724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813003.420702:0:8724:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff948a7b703380) 00000020:00000080:1.0:1788813003.420720:0:8724:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788813003.420723:0:8724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788813003.420775:0:8724:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788813003.420779:0:8724:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788813003.420784:0:8724:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff702858 00010000:00080000:1.0:1788813003.420804:0:8724:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948942016800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813003.421017:0:8724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:0.0:1788813003.431795:0:8724:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788813003.431824:0:8724:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788813003.432024:0:8724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813003.432184:0:8724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813003.432242:0:8724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788813003.432305:0:8724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788813003.432616:0:8725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813003.432621:0:8725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788813003.433020:0:8724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788813003.433031:0:8724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788813003.433066:0:8724:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788813003.433089:0:8724:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff70285f 00000100:00080000:3.0:1788813003.433105:0:8724:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788813003.433117:0:8724:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff948942016800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813003.433153:0:8724:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a6eb02300 x1875706313204480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813003.433177:0:8724:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788813003.433208:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313204480:0@lo:8: 00000020:01000000:3.0:1788813003.433244:0:8724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813003.433247:0:8724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813003.433249:0:8724:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788813003.433252:0:8724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813003.433256:0:8724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813003.433257:0:8724:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788813003.433259:0:8724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788813003.433261:0:8724:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788813003.433273:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.433282:0:8724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8724:1875706313204608:0@lo:502: 00000100:00100000:3.0:1788813003.433324:0:8724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.433342:0:8724:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489422569c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.433366:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313204480 00000100:00100000:1.0:1788813003.433374:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313204480 00000100:00100000:1.0:1788813003.433447:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813003.433455:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1875706313204480:12345-0@lo:8: 00010000:00080000:1.0:1788813003.433478:0:8403:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:1.0:1788813003.433502:0:8403:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff702866 00002000:00100000:1.0:1788813003.433512:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff948942c79000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788813003.433515:0:8403:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788813003.433517:0:8403:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788813003.433563:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788813003.433580:0:8403:0:(import.c:65:import_set_state_nolock()) ffff948942c7a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813003.433624:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1875706313204480:12345-0@lo:8: Request processed in 169us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.433631:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788813003.433667:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6eb02300 x1875706313204480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813003.433678:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788813003.433685:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788813003.433691:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788813003.433696:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788813003.433698:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948942016800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788813003.433711:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313204608 00000100:00100000:1.0:1788813003.433715:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313204608 00000004:00080000:3.0:1788813003.433716:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788813003.433720:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313204480:0@lo:8: 00000004:00080000:3.0:1788813003.433738:0:8725:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788813003.433775:0:8725:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 156452842596ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788813003.433781:0:8725:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788813003.433852:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788813003.433859:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:8724:x1875706313204608:12345-0@lo:502: 00000100:00100000:3.0:1788813003.434031:0:8724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8724:1875706313204608:0@lo:502: 00000100:00100000:1.0:1788813003.434031:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:8724:x1875706313204608:12345-0@lo:502: Request processed in 172us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813003.434042:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000020:01000000:3.0:1788813003.434054:0:8724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813003.434058:0:8724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813003.434059:0:8724:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788813003.434062:0:8724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788813003.434111:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788813003.434133:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788813003.434142:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff702843 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70284a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813003.434153:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff702843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70284a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813003.434162:0:6492:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788813003.434165:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a60186000 from 1 10000000:01000000:3.0:1788813003.434167:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788813003.434190:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff70286d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813003.434198:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff70286d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813003.434207:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff70286d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813003.434219:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313204736:0@lo:101: 00000100:00100000:3.0:1788813003.434244:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.434277:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46897180 going to sleep for 11 seconds 00000100:00100000:0.0:1788813003.434285:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313204736 00000100:00100000:0.0:1788813003.434290:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313204736 00000100:00100000:0.0:1788813003.434311:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788813003.434316:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313204736:12345-0@lo:101: 00010000:00010000:0.0:1788813003.434324:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813003.434336:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cda200/0xf32533d6ff702874 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70286d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.434356:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cda200/0xf32533d6ff702874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70286d expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.434367:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cda200/0xf32533d6ff702874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70286d expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.434376:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cda200, rc 0) 00000100:00100000:0.0:1788813003.434404:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313204736:12345-0@lo:101: Request processed in 88us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813003.434418:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788813003.434491:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313204736:0@lo:101: 00010000:00010000:3.0:1788813003.434502:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff70286d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702874 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813003.434516:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff70286d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702874 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813003.434561:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313204864:0@lo:501: 00000100:00100000:3.0:1788813003.434586:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.434607:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46897180 going to sleep for 11 seconds 00000100:00100000:0.0:1788813003.434629:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313204864 00000100:00100000:0.0:1788813003.434633:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313204864 00000100:00100000:0.0:1788813003.434651:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788813003.434657:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313204864:12345-0@lo:501: 00000100:00100000:0.0:1788813003.434736:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313204864:12345-0@lo:501: Request processed in 78us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813003.434742:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788813003.434754:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313204864:0@lo:501: 00000100:00100000:3.0:1788813003.434776:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313204992:0@lo:503: 00000100:00100000:3.0:1788813003.434809:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.434828:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46897180 going to sleep for 11 seconds 00000100:00100000:0.0:1788813003.434838:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313204992 00000100:00100000:0.0:1788813003.434842:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313204992 00000100:00100000:0.0:1788813003.434863:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788813003.434868:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313204992:12345-0@lo:503: 00000100:00100000:0.0:1788813003.434959:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313204992:12345-0@lo:503: Request processed in 89us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813003.434965:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313204992:0@lo:503: 00000100:00100000:0.0:1788813003.434965:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788813003.435197:0:8727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8727:1875706313205120:0@lo:502: 00000100:00100000:0.0:1788813003.435226:0:8727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813003.435242:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313205120 00000100:00100000:0.0:1788813003.435245:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313205120 00000100:00100000:0.0:1788813003.435261:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788813003.435266:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:8727:x1875706313205120:12345-0@lo:502: 00000100:00100000:0.0:1788813003.435317:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:8727:x1875706313205120:12345-0@lo:502: Request processed in 51us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813003.435321:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788813003.435346:0:8727:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813003.435353:0:8727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8727:1875706313205120:0@lo:502: 00000020:01000000:0.0:1788813003.435370:0:8727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813003.435375:0:8727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813003.435377:0:8727:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788813003.435381:0:8727:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a60186000 00000020:00000080:0.0:1788813003.435383:0:8727:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788813003.435396:0:8727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8727:1875706313205248:0@lo:502: 00000100:00100000:0.0:1788813003.435421:0:8727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813003.435437:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313205248 00000100:00100000:0.0:1788813003.435453:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313205248 00000100:00100000:0.0:1788813003.435473:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788813003.435478:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:8727:x1875706313205248:12345-0@lo:502: 00000100:00100000:0.0:1788813003.435518:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:8727:x1875706313205248:12345-0@lo:502: Request processed in 40us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813003.435521:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788813003.435540:0:8727:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a485dae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813003.435547:0:8727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:8727:1875706313205248:0@lo:502: 00000020:01000000:0.0:1788813003.435558:0:8727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813003.435561:0:8727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813003.435562:0:8727:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788813003.435564:0:8727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788813003.435614:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788813003.435631:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788813003.435638:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff70286d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702874 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813003.435647:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff70286d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702874 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813003.435655:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788813003.435657:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff948a506e4d40 from 1 10000000:01000000:3.0:1788813003.435660:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788813003.435680:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151da00/0xf32533d6ff70287b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813003.435687:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a4151da00/0xf32533d6ff70287b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813003.435701:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a4151da00/0xf32533d6ff70287b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813003.435713:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313205376:0@lo:101: 00000100:00100000:3.0:1788813003.435737:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.435757:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489422569c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813003.435773:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313205376 00000100:00100000:0.0:1788813003.435777:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313205376 00000100:00100000:0.0:1788813003.435795:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788813003.435800:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313205376:12345-0@lo:101: 00010000:00010000:0.0:1788813003.435807:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813003.435817:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cda400/0xf32533d6ff702882 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70287b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.435842:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cda400/0xf32533d6ff702882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70287b expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.435851:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cda400/0xf32533d6ff702882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70287b expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813003.435858:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cda400, rc 0) 00000100:00100000:0.0:1788813003.435891:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313205376:12345-0@lo:101: Request processed in 91us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813003.435896:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788813003.435957:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313205376:0@lo:101: 00010000:00010000:3.0:1788813003.435968:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a4151da00/0xf32533d6ff70287b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702882 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813003.435977:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a4151da00/0xf32533d6ff70287b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702882 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813003.436014:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313205504:0@lo:501: 00000100:00100000:3.0:1788813003.436037:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813003.436063:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489422569c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813003.436298:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313205504 00000100:00100000:0.0:1788813003.436302:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313205504 00000100:00100000:0.0:1788813003.436330:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788813003.436336:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313205504:12345-0@lo:501: 00000100:00100000:0.0:1788813003.436393:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313205504:12345-0@lo:501: Request processed in 57us (355us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813003.436400:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788813003.436518:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313205504:0@lo:501: 10000000:01000000:3.0:1788813003.436540:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788813003.436544:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151da00/0xf32533d6ff70287b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702882 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813003.436552:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4151da00/0xf32533d6ff70287b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702882 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788813003.437735:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788813003.437836:0:8726:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788813003.437858:0:8726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8726:1875706313205760:0@lo:7: 00000100:00100000:0.0:1788813003.437900:0:8726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813003.437926:0:8726:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813003.437974:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313205760 00000100:00100000:0.0:1788813003.437979:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313205760 00000100:00100000:0.0:1788813003.438019:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813003.438025:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8726:x1875706313205760:12345-0@lo:7: 00002000:00080000:0.0:1788813003.440386:0:8404:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788813003.440395:0:8404:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788813003.440482:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8726:x1875706313205760:12345-0@lo:7: Request processed in 2454us (2579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813003.440491:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788813003.440546:0:8726:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489419b5880 x1875706313205760/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788813019 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813003.440557:0:8726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8726:1875706313205760:0@lo:7: 00000004:00080000:0.0:1788813003.440567:0:8726:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788813003.440592:0:8726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8726:1875706313205888:0@lo:5: 00000100:00100000:0.0:1788813003.440613:0:8726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813003.440634:0:8726:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b5d43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813003.440724:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313205888 00000100:00100000:1.0:1788813003.440730:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313205888 00000100:00100000:1.0:1788813003.440769:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813003.440777:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8726:x1875706313205888:12345-0@lo:5: 00002000:00080000:1.0:1788813003.440797:0:8403:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788813003.440801:0:8403:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788813003.443521:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313205632:0@lo:13: 00000100:00100000:2.0:1788813003.443590:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788813003.443640:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788813003.443655:0:8399:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:2.0:1788813003.443660:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313205632 00000001:00100000:3.0:1788813003.443666:0:8399:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788813003.443667:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313205632 00000001:00080000:3.0:1788813003.443679:0:8399:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1788813003.443701:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813003.443708:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64342300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313205632:12345-0@lo:13: 00002000:00000024:2.0:1788813003.443728:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:3.0:1788813003.443749:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8726:x1875706313205888:12345-0@lo:5: Request processed in 2972us (3134us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788813003.443758:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64342300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313205632:12345-0@lo:13: Request processed in 52us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813003.443761:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813003.443764:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788813003.443796:0:8726:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489419b5880 x1875706313205888/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813019 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813003.443807:0:8726:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788813003.443812:0:8726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8726:1875706313205888:0@lo:5: 00000004:00080000:3.0:1788813003.443823:0:8726:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00010000:00080000:2.0:1788813003.443876:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489419b7800 x1875706313205632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813003.443891:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313205632:0@lo:13: 00010000:00010000:3.0:1788813003.622954:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788813003.844919:0:8781:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1788813004.484812:0:8833:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788813004.485217:0:8833:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788813004.644559:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813004.644770:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313206016:0@lo:41: 00000100:00100000:2.0:1788813004.644843:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813004.644969:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313206016 00000100:00100000:0.0:1788813004.644985:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313206016 00000100:00100000:0.0:1788813004.645528:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788813004.645541:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313206016:12345-0@lo:41: 00000004:00000024:0.0:1788813004.645588:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788813004.645679:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313206016:12345-0@lo:41: Request processed in 141us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813004.645687:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788813004.645745:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313206016:0@lo:41: 00000100:00100000:3.0:1788813005.156159:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813005.156562:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313206144:0@lo:41: 00000100:00100000:3.0:1788813005.156632:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813005.156758:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313206144 00000100:00100000:0.0:1788813005.156766:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313206144 00000100:00100000:0.0:1788813005.156811:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788813005.156821:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313206144:12345-0@lo:41: 00000004:00000024:0.0:1788813005.156857:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788813005.156908:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313206144:12345-0@lo:41: Request processed in 89us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813005.156916:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788813005.156959:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313206144:0@lo:41: 00010000:00010000:2.0:1788813005.670731:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788813006.452094:0:8934:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813006.452530:0:8934:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788813006.693955:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788813006.955187:0:8982:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813006.955198:0:8982:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1788813007.717095:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813008.740435:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313206528:0@lo:400: 00000100:00100000:0.0:1788813008.740539:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813008.740603:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313207040:0@lo:400: 00000100:00100000:0.0:1788813008.740648:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813008.740680:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788813008.740686:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313206656:0@lo:400: 00000100:00100000:0.0:1788813008.740708:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813008.740726:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313207168:0@lo:400: 00000100:00100000:0.0:1788813008.740750:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813008.740793:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313206528 00000100:00100000:2.0:1788813008.740897:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313206272:0@lo:400: 00000100:00100000:2.0:1788813008.740988:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813008.741013:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313206784:0@lo:400: 00000100:00100000:2.0:1788813008.741036:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813008.741067:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313207296:0@lo:400: 00000100:00100000:2.0:1788813008.741090:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813008.741111:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788813008.741117:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313206400:0@lo:400: 00000100:00100000:2.0:1788813008.741139:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813008.741156:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313206912:0@lo:400: 00000100:00100000:2.0:1788813008.741177:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813008.741206:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313206784 00000100:00100000:2.0:1788813008.741211:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313206784 00000100:00100000:2.0:1788813008.741259:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813008.741269:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313206784:12345-0@lo:400: 00000100:00100000:2.0:1788813008.741331:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313206784:12345-0@lo:400: Request processed in 63us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813008.741338:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813008.741371:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313207168 00000100:00100000:2.0:1788813008.741375:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313207168 00000100:00100000:2.0:1788813008.741424:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313207296 00000100:00100000:2.0:1788813008.741428:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313207296 00000100:00100000:2.0:1788813008.741446:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813008.741451:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313207168:12345-0@lo:400: 00000100:00100000:2.0:1788813008.741489:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313207168:12345-0@lo:400: Request processed in 37us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813008.741504:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813008.741516:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813008.741522:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313207296:12345-0@lo:400: 00000100:00100000:2.0:1788813008.741550:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313207296:12345-0@lo:400: Request processed in 28us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813008.741556:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813008.741574:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313207040 00000100:00100000:2.0:1788813008.741578:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313207040 00000100:00100000:1.0:1788813008.741590:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313206656 00000100:00100000:1.0:1788813008.741594:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313206656 00000100:00100000:2.0:1788813008.741599:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313206400 00000100:00100000:2.0:1788813008.741602:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313206400 00000100:00100000:2.0:1788813008.741610:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313206912 00000100:00100000:2.0:1788813008.741612:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313206912 00000100:00100000:1.0:1788813008.741613:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813008.741620:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313207040:12345-0@lo:400: 00000100:00100000:2.0:1788813008.741626:0:6494:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788813008.741634:0:6494:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1788813008.741652:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813008.741655:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313207040:12345-0@lo:400: Request processed in 36us (1006us total) trans 0 rc 0/0 00000100:00080000:2.0:1788813008.741656:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788813008.741659:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813008.741660:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813008.741674:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813008.741680:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313206656:12345-0@lo:400: 00000100:00100000:1.0:1788813008.741706:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313206656:12345-0@lo:400: Request processed in 27us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813008.741711:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813008.741723:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813008.741728:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313206400:12345-0@lo:400: 00000100:00100000:1.0:1788813008.741750:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313206400:12345-0@lo:400: Request processed in 23us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813008.741756:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813008.741774:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813008.741780:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313206912:12345-0@lo:400: 00010000:00080000:2.0:1788813008.741790:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489419b6300 x1875706313206400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813008.741805:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313206912:12345-0@lo:400: Request processed in 26us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813008.741811:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813008.741849:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313206272 00000100:00100000:1.0:1788813008.741853:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313206272 00000100:00100000:1.0:1788813008.741879:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788813008.741886:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:3627:x1875706313206272:12345-0@lo:400: 00000100:00100000:1.0:1788813008.741915:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:3627:x1875706313206272:12345-0@lo:400: Request processed in 30us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813008.741921:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:1.0:1788813008.741986:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489419b5c00 x1875706313206656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813008.742068:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313206528 00000100:00100000:0.0:1788813008.742102:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788813008.742108:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313206528:12345-0@lo:400: 00000100:00100000:0.0:1788813008.742142:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313206528:12345-0@lo:400: Request processed in 35us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813008.742147:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788813008.742226:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813008.742428:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313206400:0@lo:400: 00010000:00080000:2.0:1788813008.742448:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489419b7b80 x1875706313206912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813008.742456:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313206912:0@lo:400: 00000100:00100000:2.0:1788813008.742465:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313206272:0@lo:400: 00000100:00100000:2.0:1788813008.742473:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313206784:0@lo:400: 00010000:00080000:2.0:1788813008.742482:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489419b7100 x1875706313207296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813008.742499:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313207296:0@lo:400: 00000100:00100000:2.0:1788813008.742611:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813008.742619:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313207552:0@lo:13: 00000100:00100000:1.0:1788813008.742808:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313206656:0@lo:400: 00010000:00080000:1.0:1788813008.742829:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489419b5880 x1875706313207168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813008.742837:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788813008.742848:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313207168:0@lo:400: 00000100:00100000:1.0:1788813008.742859:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313206528:0@lo:400: 00010000:00080000:1.0:1788813008.742870:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489419b7800 x1875706313207040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813008.742878:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313207040:0@lo:400: 00000100:00100000:3.0:1788813008.744241:0:8726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8726:1875706313207680:0@lo:700: 00000100:00100000:0.0:1788813008.744352:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813008.744367:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313207424:0@lo:13: 00000100:00100000:2.0:1788813008.744584:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813008.744649:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313207552 00000100:00100000:2.0:1788813008.744657:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313207552 00000100:00100000:2.0:1788813008.744706:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813008.744714:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313207552:12345-0@lo:13: 00002000:00000024:2.0:1788813008.744748:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788813008.744791:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313207552:12345-0@lo:13: Request processed in 78us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813008.744797:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788813008.744853:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a64340700 x1875706313207552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813008.744871:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313207552:0@lo:13: 00000100:00100000:3.0:1788813008.748457:0:8726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813008.748532:0:8726:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ec020c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813008.750360:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313207680 00000100:00100000:2.0:1788813008.750374:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313207680 00000100:00100000:2.0:1788813008.750466:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813008.750476:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8726:x1875706313207680:12345-0@lo:700: 00000100:00100000:0.0:1788813008.750490:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813008.750550:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313207424 00000100:00100000:0.0:1788813008.750554:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313207424 00000100:00100000:0.0:1788813008.750582:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813008.750589:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1875706313207424:12345-0@lo:13: 00002000:00000024:0.0:1788813008.750605:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788813008.750665:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1875706313207424:12345-0@lo:13: Request processed in 76us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813008.750683:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788813008.750797:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6eb02300 x1875706313207424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813008.750823:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313207424:0@lo:13: 00000100:00100000:3.0:1788813008.755217:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8726:x1875706313207680:12345-0@lo:700: Request processed in 4729us (6756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813008.755237:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788813008.755324:0:8726:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6eb03100 x1875706313207680/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788813024 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813008.755351:0:8726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8726:1875706313207680:0@lo:700: 00000004:02000040:2.0:1788813008.762253:0:8726:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1788813008.766513:0:8726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8726:1875706313207808:0@lo:5: 00000100:00100000:2.0:1788813008.766607:0:8726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813008.766762:0:8726:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a488b60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813008.766871:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313207808 00000100:00100000:3.0:1788813008.766881:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313207808 00000100:00100000:3.0:1788813008.767655:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813008.767670:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8726:x1875706313207808:12345-0@lo:5: 00002000:00080000:2.0:1788813008.772714:0:8403:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788813008.772731:0:8403:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1788813008.774838:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8726:x1875706313207808:12345-0@lo:5: Request processed in 7168us (8227us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788813008.774849:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788813008.774916:0:8726:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76404e00 x1875706313207808/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813024 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813008.774954:0:8726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8726:1875706313207808:0@lo:5: 00000004:00080000:2.0:1788813008.774970:0:8726:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:3.0:1788813009.764075:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813009.764103:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313207936:0@lo:41: 00010000:00010000:2.0:1788813009.764140:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813009.764178:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813009.764240:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313207936 00000100:00100000:0.0:1788813009.764247:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313207936 00000100:00100000:0.0:1788813009.764285:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788813009.764292:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313207936:12345-0@lo:41: 00000004:00000024:0.0:1788813009.764321:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788813009.764369:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313207936:12345-0@lo:41: Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813009.764377:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813009.764421:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313207936:0@lo:41: 00000100:00100000:3.0:1788813010.276093:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313208064:0@lo:41: 00000100:00100000:3.0:1788813010.276169:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813010.276247:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313208064 00000100:00100000:3.0:1788813010.276254:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313208064 00000100:00100000:3.0:1788813010.276297:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788813010.276305:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313208064:12345-0@lo:41: 00000004:00000024:3.0:1788813010.276465:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788813010.276526:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313208064:12345-0@lo:41: Request processed in 221us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813010.276533:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788813010.276579:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313208064:0@lo:41: 00010000:00010000:1.0:1788813010.793129:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813011.812054:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788813011.814094:0:9481:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788813011.814097:0:9481:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788813011.814098:0:9481:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788813011.814255:0:9481:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff948a7b522000 00000020:01000004:2.0:1788813011.814270:0:9481:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788813011.814285:0:9481:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788813011.814300:0:9481:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff948a64348000) 00000020:00000080:2.0:1788813011.814319:0:9481:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788813011.839184:0:9481:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788813011.839242:0:9481:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1788813011.860346:0:9481:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788813011.860621:0:9481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788813011.860635:0:9481:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788813011.860655:0:9481:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf32533d6ff702890 00000020:01000004:3.0:1788813011.860663:0:9481:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788813011.860686:0:9481:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788813011.860691:0:9481:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788813011.860697:0:9481:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788813011.860728:0:9481:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788813011.860733:0:9481:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788813011.871573:0:9481:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788813011.871604:0:9481:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.113@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788813011.871607:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788813011.871608:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813011.871610:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813011.871610:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813011.871611:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813011.871612:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813011.871613:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813011.871614:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788813011.871615:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788813011.871616:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813011.871616:0:9481:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788813011.871620:0:9481:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788813011.871621:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788813011.871622:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813011.871622:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813011.871625:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813011.871626:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813011.871627:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813011.871627:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813011.871628:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788813011.871628:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788813011.871629:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813011.871630:0:9481:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788813011.871653:0:9481:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788813011.871668:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313208192:0@lo:253: 00000100:00100000:2.0:1788813011.872598:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813011.872650:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813011.872654:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313208192 00000100:00100000:0.0:1788813011.872663:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313208192 00000100:00100000:0.0:1788813011.872753:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788813011.872764:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:9481:x1875706313208192:12345-0@lo:253: 20000000:01000000:0.0:1788813011.872796:0:6488:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788813011.872801:0:6488:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788813011.872805:0:6488:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788813011.872809:0:6488:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788813011.873086:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813011.873208:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1788813011.873222:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788813011.873237:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1788813011.873244:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788813011.873257:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1788813011.873273:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1788813011.873396:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1788813011.873410:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.113@tcp 20000000:01000000:0.0:1788813011.873412:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.113@tcp (null) (null) (null) 00000040:00080000:0.0:1788813011.873425:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1788813011.873429:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788813011.873442:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1788813011.873447:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.113@tcp (null) (null) 00000040:00080000:0.0:1788813011.873458:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1788813011.873464:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788813011.873474:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1788813011.873487:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1788813011.873550:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1788813011.873559:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.113@tcp 20000000:01000000:0.0:1788813011.873561:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.113@tcp (null) (null) (null) 00000040:00080000:0.0:1788813011.873571:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1788813011.873575:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788813011.873585:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1788813011.873589:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.113@tcp (null) (null) 00000040:00080000:0.0:1788813011.873599:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1788813011.873603:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788813011.873614:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1788813011.873627:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1788813011.874127:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1788813011.874146:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.113@tcp 20000000:01000000:0.0:1788813011.874149:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.113@tcp (null) (null) (null) 00000040:00080000:0.0:1788813011.874165:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1788813011.874174:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788813011.874187:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1788813011.874195:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.113@tcp (null) (null) 00000040:00080000:0.0:1788813011.874206:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1788813011.874218:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788813011.874229:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1788813011.874241:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1788813011.874252:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788813011.874254:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788813011.874258:0:6488:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788813011.874299:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788813011.874301:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788813011.875219:0:9487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1788813011.875246:0:9487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1788813011.875262:0:9487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1788813011.875636:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1788813011.875659:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1788813011.875675:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1788813011.875685:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788813011.875687:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788813011.876087:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1788813011.876105:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1788813011.876119:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1788813011.876278:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1788813011.876297:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1788813011.876311:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1788813011.876319:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788813011.876398:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788813011.876690:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1788813011.877230:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1788813011.877252:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1788813011.877268:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1788813011.877279:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788813011.877281:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788813011.877536:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788813011.877585:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788813011.877598:0:9490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788813011.877731:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788813011.877748:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1788813011.877760:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1788813011.877768:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788813011.877769:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788813011.878074:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1788813011.878093:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1788813011.878111:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1788813011.878259:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1788813011.878278:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1788813011.878294:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:2.0:1788813011.878309:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788813011.878402:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a821e4200/0xf32533d6ff702897 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.878427:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a44cdb400/0xf32533d6ff702771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70276a expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.878435:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70279b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702794 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.878441:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a4166f600/0xf32533d6ff7027da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7027d3 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.878448:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff7027f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7027ef expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.878454:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70282e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702827 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.878460:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a44cda000/0xf32533d6ff70284a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702843 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.878467:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a44cda400/0xf32533d6ff702882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70287b expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.878474:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948a821e4200/0xf32533d6ff702897 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.878512:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a44cda400/0xf32533d6ff702882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff70287b expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.878526:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a44cda400/0xf32533d6ff702882 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff70287b expref: 21 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.878551:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875706313208320:0@lo:104: 00000100:00100000:2.0:1788813011.878608:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813011.878712:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a44cda000/0xf32533d6ff70284a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702843 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.878721:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a44cda000/0xf32533d6ff70284a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702843 expref: 21 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.878730:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875706313208448:0@lo:104: 00000100:00100000:2.0:1788813011.878751:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813011.878876:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70282e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702827 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.878884:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70282e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702827 expref: 21 pid: 6487 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.878892:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875706313208576:0@lo:104: 00000100:00100000:2.0:1788813011.878911:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813011.878965:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313208320 00000100:00100000:3.0:1788813011.878973:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313208320 00000100:00100000:1.0:1788813011.879111:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313208448 00000100:00100000:1.0:1788813011.879115:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313208448 00000100:00100000:1.0:1788813011.879140:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813011.879148:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6488:x1875706313208320:12345-0@lo:104: 00010000:00010000:1.0:1788813011.879160:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a4151da00/0xf32533d6ff70287b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702882 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879219:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813011.879225:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6488:x1875706313208320:12345-0@lo:104: Request processed in 78us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813011.879231:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813011.879248:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788813011.879255:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6488:x1875706313208448:12345-0@lo:104: 00010000:00010000:1.0:1788813011.879262:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff702843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70284a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879294:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813011.879299:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6488:x1875706313208448:12345-0@lo:104: Request processed in 46us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813011.879305:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1788813011.879334:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813011.879341:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a4151da00/0xf32533d6ff70287b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702882 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879349:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4151da00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813011.879354:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a4151da00/0xf32533d6ff70287b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702882 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879372:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4151da00/0xf32533d6ff70287b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702882 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813011.879388:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4151da00/0xf32533d6ff70287b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702882 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813011.879393:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813011.879426:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a4151da00/0xf32533d6ff70287b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702882 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879433:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813011.879452:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a4151da00/0xf32533d6ff70287b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702882 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879459:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4151da00/0xf32533d6ff70287b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702882 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879469:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813011.879472:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff702843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70284a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879477:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda600 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813011.879479:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff702843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff70284a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879485:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff702843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff70284a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813011.879491:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff702843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff70284a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813011.879496:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813011.879518:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff702843 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70284a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879523:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813011.879539:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff702843 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70284a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879545:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff702843 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70284a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879554:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813011.879555:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813011.879557:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813011.879569:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313208704:0@lo:103: 00000100:00100000:1.0:1788813011.879595:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813011.879636:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313208832:0@lo:103: 00000100:00100000:1.0:1788813011.879671:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813011.879703:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313208704 00000100:00100000:1.0:1788813011.879706:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313208704 00010000:00010000:1.0:1788813011.879724:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a44cda400/0xf32533d6ff702882 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70287b expref: 22 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813011.879743:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313208832 00000100:00100000:1.0:1788813011.879746:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313208832 00010000:00010000:1.0:1788813011.879758:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a44cda000/0xf32533d6ff70284a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702843 expref: 23 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813011.879776:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813011.879783:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:3628:x1875706313208704:12345-0@lo:103: 00010000:00010000:1.0:1788813011.879793:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813011.879803:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a44cda400/0xf32533d6ff702882 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70287b expref: 23 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879814:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a44cda400/0xf32533d6ff702882 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff70287b expref: 23 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879828:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813011.879855:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:3628:x1875706313208704:12345-0@lo:103: Request processed in 73us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813011.879861:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813011.879874:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788813011.879881:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:3625:x1875706313208832:12345-0@lo:103: 00010000:00010000:1.0:1788813011.879888:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813011.879893:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a44cda000/0xf32533d6ff70284a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702843 expref: 22 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879900:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a44cda000/0xf32533d6ff70284a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702843 expref: 22 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.879909:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813011.879962:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:3625:x1875706313208832:12345-0@lo:103: Request processed in 81us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813011.879967:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788813011.880008:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313208832:0@lo:103: 00000100:00100000:1.0:1788813011.880031:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313208704:0@lo:103: 00010000:00010000:0.0:1788813011.880096:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813011.880227:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff7027f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7027ef expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.880237:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff7027f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7027ef expref: 21 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.880245:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875706313208960:0@lo:104: 00000100:00100000:2.0:1788813011.880268:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813011.880284:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a4166f600/0xf32533d6ff7027da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7027d3 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.880301:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a4166f600/0xf32533d6ff7027da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7027d3 expref: 21 pid: 6487 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.880309:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875706313209088:0@lo:104: 00000100:00100000:2.0:1788813011.880329:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813011.880344:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70279b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702794 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.880352:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70279b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702794 expref: 21 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.880369:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875706313209216:0@lo:104: 00000100:00100000:2.0:1788813011.880392:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813011.880409:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a44cdb400/0xf32533d6ff702771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff70276a expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.880417:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a44cdb400/0xf32533d6ff702771 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff70276a expref: 21 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.880425:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875706313209344:0@lo:104: 00000100:00100000:2.0:1788813011.880442:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46415b40 going to sleep for 11 seconds 00010000:00010000:2.0:1788813011.880455:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cda400/0xf32533d6ff702882 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff70287b expref: 21 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.880464:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875706313208320:0@lo:104: 00010000:00010000:2.0:1788813011.880474:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cda000/0xf32533d6ff70284a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702843 expref: 20 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.880492:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875706313208448:0@lo:104: 00000100:00100000:1.0:1788813011.880549:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788813011.880565:0:6476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813011.880574:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313208576 00000100:00100000:1.0:1788813011.880578:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313208576 00000100:00100000:1.0:1788813011.880603:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313208960 00000100:00100000:1.0:1788813011.880606:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313208960 00000100:00100000:1.0:1788813011.880615:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313209088 00000100:00100000:1.0:1788813011.880618:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313209088 00000100:00100000:1.0:1788813011.880625:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313209216 00000100:00100000:1.0:1788813011.880627:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313209216 00000100:00100000:1.0:1788813011.880636:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313209344 00000100:00100000:1.0:1788813011.880638:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313209344 00000100:00100000:1.0:1788813011.880649:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788813011.880655:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+7:6488:x1875706313208576:12345-0@lo:104: 00010000:00010000:1.0:1788813011.880663:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff702827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70282e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.880768:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875706313208576:0@lo:104: 00010000:00010000:1.0:1788813011.880796:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813011.880802:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+7:6488:x1875706313208576:12345-0@lo:104: Request processed in 148us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813011.880809:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788813011.880822:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788813011.880828:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+6:6488:x1875706313208960:12345-0@lo:104: 00010000:00010000:1.0:1788813011.880836:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a4166f000/0xf32533d6ff7027ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7027f6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.880906:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875706313208960:0@lo:104: 00010000:00010000:0.0:1788813011.881031:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813011.881037:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff702827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70282e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.881044:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8800 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813011.881047:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff702827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff70282e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.881065:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff702827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff70282e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813011.881071:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff702827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff70282e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813011.881077:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813011.881110:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff702827 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70282e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.881117:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813011.881132:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff702827 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70282e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.881139:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff702827 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70282e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.881148:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813011.881151:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a4166f000/0xf32533d6ff7027ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7027f6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.881156:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f000 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813011.881158:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a4166f000/0xf32533d6ff7027ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7027f6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.881165:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4166f000/0xf32533d6ff7027ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7027f6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813011.881171:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4166f000/0xf32533d6ff7027ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7027f6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813011.881181:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813011.881193:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a4166f000/0xf32533d6ff7027ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7027f6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.881198:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813011.881209:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a4166f000/0xf32533d6ff7027ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7027f6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.881215:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4166f000/0xf32533d6ff7027ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7027f6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.881223:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813011.881225:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813011.881226:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813011.881272:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313209472:0@lo:103: 00000100:00100000:3.0:1788813011.881300:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.881345:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313209472 00000100:00100000:0.0:1788813011.881351:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313209472 00010000:00010000:0.0:1788813011.881386:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70282e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702827 expref: 20 pid: 6487 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813011.881429:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788813011.881438:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:3626:x1875706313209472:12345-0@lo:103: 00010000:00010000:0.0:1788813011.881448:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813011.881453:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70282e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702827 expref: 20 pid: 6487 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.881460:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70282e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702827 expref: 20 pid: 6487 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.881469:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70282e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702827 expref: 20 pid: 6487 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.881490:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813011.881520:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788813011.881527:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+6:6488:x1875706313208960:12345-0@lo:104: Request processed in 699us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813011.881535:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813011.881545:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:3626:x1875706313209472:12345-0@lo:103: Request processed in 108us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813011.881553:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813011.881555:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788813011.881564:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+5:6488:x1875706313209088:12345-0@lo:104: 00010000:00010000:1.0:1788813011.881573:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff7027d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7027da expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813011.881592:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313209472:0@lo:103: 00010000:00010000:2.0:1788813011.881845:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813011.881850:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff7027d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7027da expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.881857:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166fc00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:2.0:1788813011.881860:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff7027d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7027da expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.881866:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff7027d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7027da expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813011.881872:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff7027d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7027da expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813011.881877:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788813011.881908:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff7027d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7027da expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.881915:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813011.881924:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff7027d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7027da expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.881949:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4166fc00/0xf32533d6ff7027d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7027da expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.881971:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813011.881972:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813011.881974:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813011.881992:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313209600:0@lo:103: 00000100:00100000:0.0:1788813011.882029:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813011.882049:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788813011.882057:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+5:6488:x1875706313209088:12345-0@lo:104: Request processed in 495us (1726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813011.882065:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788813011.882076:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313209600 00000100:00100000:3.0:1788813011.882082:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313209600 00000100:00100000:0.0:1788813011.882083:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813011.882087:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788813011.882095:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313209728:0@lo:103: 00000100:00100000:1.0:1788813011.882101:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7cc11450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6488:x1875706313209216:12345-0@lo:104: 00010000:00010000:3.0:1788813011.882104:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff7027f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7027ef expref: 19 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.882114:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff702794 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70279b expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813011.882123:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813011.882133:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313209728 00000100:00100000:3.0:1788813011.882138:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313209728 00010000:00010000:3.0:1788813011.882154:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a4166f600/0xf32533d6ff7027da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7027d3 expref: 20 pid: 6487 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813011.882164:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813011.882174:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50686850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:3627:x1875706313209600:12345-0@lo:103: 00010000:00010000:2.0:1788813011.882176:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813011.882182:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff702794 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70279b expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.882185:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788813011.882188:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788813011.882195:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff7027f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7027ef expref: 20 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.882196:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5a00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:2.0:1788813011.882201:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff702794 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff70279b expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813011.882204:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:3627:x1875706313209728:12345-0@lo:103: 00010000:00010000:2.0:1788813011.882218:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff702794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff70279b expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.882222:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813011.882222:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff7027f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7027ef expref: 20 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813011.882229:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff702794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff70279b expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.882233:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a4166f600/0xf32533d6ff7027da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7027d3 expref: 20 pid: 6487 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813011.882239:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813011.882241:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff7027f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7027ef expref: 20 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.882259:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a4166f600/0xf32533d6ff7027da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7027d3 expref: 19 pid: 6487 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.882261:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff702794 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70279b expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.882280:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813011.882290:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff702794 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70279b expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.882296:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a821e5a00/0xf32533d6ff702794 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70279b expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.882306:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813011.882313:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813011.882315:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813011.882390:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788813011.882397:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7cc11450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6488:x1875706313209216:12345-0@lo:104: Request processed in 302us (2003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813011.882408:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1788813011.882411:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813011.882441:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788813011.882448:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6488:x1875706313209344:12345-0@lo:104: 00000100:00100000:3.0:1788813011.882452:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:3627:x1875706313209728:12345-0@lo:103: Request processed in 252us (327us total) trans 0 rc 0/0 00010000:00010000:1.0:1788813011.882456:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff70276a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702771 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813011.882462:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1788813011.882510:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813011.882513:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813011.882516:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff70276a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702771 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.882523:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4151dc00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:2.0:1788813011.882526:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff70276a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702771 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.882531:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff70276a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702771 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813011.882539:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff70276a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702771 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813011.882545:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50686850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:3627:x1875706313209600:12345-0@lo:103: Request processed in 372us (513us total) trans 0 rc 0/0 10000000:01000000:2.0:1788813011.882547:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788813011.882557:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788813011.882578:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff70276a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702771 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.882585:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813011.882592:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff70276a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702771 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.882599:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff70276a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702771 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.882615:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813011.882617:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813011.882620:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313209856:0@lo:103: 00010000:00010000:2.0:1788813011.882621:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813011.882647:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.882672:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813011.882674:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313209856 00000100:00100000:3.0:1788813011.882680:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313209856 00000100:00100000:0.0:1788813011.882681:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313209984:0@lo:103: 00010000:00010000:1.0:1788813011.882688:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788813011.882697:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6488:x1875706313209344:12345-0@lo:104: Request processed in 248us (2129us total) trans 0 rc 0/0 00010000:00010000:3.0:1788813011.882702:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70279b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702794 expref: 18 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813011.882710:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813011.882711:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788813011.882731:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313209984 00000100:00100000:3.0:1788813011.882735:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313209984 00010000:00010000:3.0:1788813011.882750:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a44cdb400/0xf32533d6ff702771 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70276a expref: 19 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813011.882750:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788813011.882758:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313209728:0@lo:103: 00000100:00100000:1.0:1788813011.882765:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:3625:x1875706313209856:12345-0@lo:103: 00010000:00010000:1.0:1788813011.882773:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788813011.882777:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313209600:0@lo:103: 00000100:00100000:3.0:1788813011.882778:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788813011.882786:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70279b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702794 expref: 19 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813011.882794:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:3625:x1875706313209984:12345-0@lo:103: 00010000:00010000:1.0:1788813011.882797:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70279b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702794 expref: 19 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.882807:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813011.882808:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813011.882814:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a44cdb400/0xf32533d6ff702771 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70276a expref: 19 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.882827:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a44cdb400/0xf32533d6ff702771 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff70276a expref: 19 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813011.882841:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:3625:x1875706313209856:12345-0@lo:103: Request processed in 81us (192us total) trans 0 rc 0/0 00010000:00010000:3.0:1788813011.882843:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948a821e4200/0xf32533d6ff702897 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813011.882849:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1788813011.882870:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e4200/0xf32533d6ff702897 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.882885:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a821e4200/0xf32533d6ff702897 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.882888:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a4166f600/0xf32533d6ff7027da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7027d3 expref: 18 pid: 6487 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.882901:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a821e4200/0xf32533d6ff702897 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813011.882911:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875706313209088:0@lo:104: 00000100:00100000:0.0:1788813011.882919:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313209856:0@lo:103: 00010000:00010000:3.0:1788813011.882920:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a821e4200/0xf32533d6ff702897 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.882952:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a4166ec00/0xf32533d6ff70279b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702794 expref: 17 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.882961:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a821e4200/0xf32533d6ff702897 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813011.882963:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875706313209216:0@lo:104: 00010000:00010000:1.0:1788813011.882975:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cdb400/0xf32533d6ff702771 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff70276a expref: 16 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813011.882983:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6488:1875706313209344:0@lo:104: 00010000:00010000:1.0:1788813011.883008:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948a821e4200/0xf32533d6ff702897 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.883017:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff948a821e4200/0xf32533d6ff702897 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.883024:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a821e4200/0xf32533d6ff702897 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.883046:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4200 already unused, calling callback (ffffffffc0dab8b0) 20000000:01000000:1.0:1788813011.883050:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1788813011.883051:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a821e4200/0xf32533d6ff702897 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.883059:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a821e4200/0xf32533d6ff702897 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.883065:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a821e4200/0xf32533d6ff702897 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.883070:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e4200/0xf32533d6ff702897 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.883080:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813011.883119:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:3625:x1875706313209984:12345-0@lo:103: Request processed in 331us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813011.883124:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788813011.883147:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313209984:0@lo:103: 00010000:00010000:2.0:1788813011.883242:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813011.884887:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:9481:x1875706313208192:12345-0@lo:253: Request processed in 12120us (12284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813011.884900:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788813011.884989:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313208192:0@lo:253: 10000000:01000000:2.0:1788813011.885002:0:9481:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788813011.885005:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788813011.885007:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813011.885008:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813011.885010:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788813011.885011:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813011.885012:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813011.885014:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813011.885015:0:9481:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788813011.885016:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813011.885018:0:9481:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788813011.885034:0:9481:0:(tgt_mount.c:101:server_register_mount()) register mount ffff948a7b522000 from lustre-OST0001 10000000:01000000:2.0:1788813011.885063:0:9481:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788813011.885066:0:9481:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788813011.885075:0:9481:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff948a506e4d40 local copy 10000000:01000000:2.0:1788813011.885079:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788813011.885107:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff70289e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.885117:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff70289e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.885127:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff70289e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.885142:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313210112:0@lo:101: 00000100:00100000:2.0:1788813011.885173:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813011.885209:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46415b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813011.885213:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313210112 00000100:00100000:0.0:1788813011.885220:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313210112 00000100:00100000:0.0:1788813011.885262:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788813011.885272:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:9481:x1875706313210112:12345-0@lo:101: 00010000:00010000:0.0:1788813011.885285:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813011.885298:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff7028a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70289e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.885320:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff7028a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70289e expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.885329:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff7028a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70289e expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.885336:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdbe00, rc 0) 00000100:00100000:0.0:1788813011.885384:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:9481:x1875706313210112:12345-0@lo:101: Request processed in 115us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813011.885390:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788813011.885421:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313210112:0@lo:101: 00010000:00010000:2.0:1788813011.885434:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff70289e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf32533d6ff7028a5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.885458:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff70289e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf32533d6ff7028a5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.885540:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313210240:0@lo:501: 00000100:00100000:2.0:1788813011.885566:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813011.885585:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46415b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813011.885603:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313210240 00000100:00100000:1.0:1788813011.885609:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313210240 00000100:00100000:1.0:1788813011.885648:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788813011.885656:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:9481:x1875706313210240:12345-0@lo:501: 00000100:00100000:1.0:1788813011.885715:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:9481:x1875706313210240:12345-0@lo:501: Request processed in 60us (148us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813011.885722:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788813011.885744:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313210240:0@lo:501: 10000000:01000000:2.0:1788813011.885756:0:9481:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788813011.885773:0:9481:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788813011.885779:0:9481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff70289e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf32533d6ff7028a5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.885787:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff70289e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf32533d6ff7028a5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.885794:0:9481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff70289e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf32533d6ff7028a5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.885856:0:9481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788813011.885876:0:9481:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff948a7b522000 10000000:01000000:2.0:1788813011.885881:0:9481:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788813011.885885:0:9481:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788813011.885887:0:9481:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788813011.885890:0:9481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788813011.885892:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788813011.885915:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7028ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.885968:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7028ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.885977:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7028ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.885989:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313210368:0@lo:101: 00000100:00100000:2.0:1788813011.886015:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813011.886033:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4a7919c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813011.886052:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313210368 00000100:00100000:1.0:1788813011.886058:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313210368 00000100:00100000:1.0:1788813011.886132:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788813011.886141:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:9481:x1875706313210368:12345-0@lo:101: 00010000:00010000:1.0:1788813011.886148:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813011.886156:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8400/0xf32533d6ff7028b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7028ac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.886172:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8400/0xf32533d6ff7028b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7028ac expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.886181:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8400/0xf32533d6ff7028b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7028ac expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813011.886189:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8400, rc 0) 00010000:00010000:0.0:1788813011.886198:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813011.886212:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff70289e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf32533d6ff7028a5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.886219:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4e00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813011.886223:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff70289e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf32533d6ff7028a5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.886231:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff70289e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf32533d6ff7028a5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813011.886235:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:9481:x1875706313210368:12345-0@lo:101: Request processed in 94us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813011.886242:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 10000000:00010000:0.0:1788813011.886268:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff70289e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf32533d6ff7028a5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813011.886274:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813011.886292:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff70289e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf32533d6ff7028a5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.886298:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788813011.886327:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313210368:0@lo:101: 00000100:00100000:1.0:1788813011.886330:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313210496:0@lo:103: 00010000:00010000:0.0:1788813011.886336:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff70289e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf32533d6ff7028a5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.886347:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7028ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7028b3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.886347:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff70289e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xf32533d6ff7028a5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.886378:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813011.886382:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7028ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7028b3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.886382:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813011.886385:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813011.886413:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.886477:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313210496 00000100:00100000:0.0:1788813011.886483:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313210496 00000100:00100000:3.0:1788813011.886485:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313210624:0@lo:501: 00000100:00100000:3.0:1788813011.886522:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.886526:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813011.886536:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:3627:x1875706313210496:12345-0@lo:103: 00000100:00100000:3.0:1788813011.886552:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a467749c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788813011.886554:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788813011.886564:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313210624 00000100:00100000:2.0:1788813011.886570:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313210624 00010000:00010000:0.0:1788813011.886570:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff7028a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff70289e expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.886584:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813011.886602:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788813011.886611:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:9481:x1875706313210624:12345-0@lo:501: 00000100:00100000:0.0:1788813011.886628:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:3627:x1875706313210496:12345-0@lo:103: Request processed in 94us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813011.886636:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813011.886710:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:9481:x1875706313210624:12345-0@lo:501: Request processed in 99us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.886718:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788813011.886726:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313210624:0@lo:501: 00000100:00100000:0.0:1788813011.886757:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313210752:0@lo:503: 00000100:00100000:3.0:1788813011.886778:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313210496:0@lo:103: 00000100:00100000:0.0:1788813011.886796:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813011.886821:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313210752 00000100:00100000:0.0:1788813011.886824:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a64231780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813011.886827:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313210752 00000100:00100000:0.0:1788813011.886891:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788813011.886901:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:9481:x1875706313210752:12345-0@lo:503: 00000100:00100000:0.0:1788813011.887051:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:9481:x1875706313210752:12345-0@lo:503: Request processed in 152us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813011.887057:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788813011.887791:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313210752:0@lo:503: 00000040:00080000:3.0:1788813011.888068:0:9481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788813011.888138:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313210880:0@lo:502: 00000100:00100000:3.0:1788813011.888178:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813011.888211:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a467746c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813011.888246:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313210880 00000100:00100000:2.0:1788813011.888252:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313210880 00000100:00100000:2.0:1788813011.888281:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788813011.888288:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:9481:x1875706313210880:12345-0@lo:502: 00000100:00100000:2.0:1788813011.888381:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:9481:x1875706313210880:12345-0@lo:502: Request processed in 93us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.888388:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788813011.888719:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313210880:0@lo:502: 00000040:00080000:3.0:1788813011.888900:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788813011.888925:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788813011.888966:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788813011.888982:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788813011.888996:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788813011.889011:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788813011.889034:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211008:0@lo:502: 00000100:00100000:3.0:1788813011.889087:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813011.889114:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a467746c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813011.889123:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313211008 00000100:00100000:0.0:1788813011.889129:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313211008 00000100:00100000:0.0:1788813011.889203:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788813011.889212:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:9481:x1875706313211008:12345-0@lo:502: 00000100:00100000:0.0:1788813011.889288:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:9481:x1875706313211008:12345-0@lo:502: Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813011.889294:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788813011.889391:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211008:0@lo:502: 00000040:00080000:3.0:1788813011.889426:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788813011.889433:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1788813011.889914:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788813011.889921:0:9492:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788813011.889928:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813011.890002:0:9492:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788813011.890017:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788813011.890040:0:9492:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff948942dc8000) 00000020:00000080:2.0:1788813011.890064:0:9492:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788813011.890072:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788813011.890153:0:9492:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a7b522000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788813011.890163:0:9492:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788813011.890170:0:9492:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf32533d6ff7028c1 00010000:00010000:2.0:1788813011.895494:0:9492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788813011.897468:0:9492:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788813011.899475:0:9492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788813011.899758:0:9492:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788813011.902047:0:9492:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788813011.902171:0:9492:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788813011.905542:0:9492:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788813011.906486:0:9492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788813011.906495:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813011.906501:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813011.906504:0:9492:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788813011.906507:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813011.906511:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813011.906512:0:9492:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788813011.906515:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788813011.906517:0:9492:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788813011.906534:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813011.906536:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813011.906538:0:9492:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788813011.906541:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788813011.906681:0:9481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788813011.906708:0:9481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788813011.906763:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7028ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7028b3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.906782:0:9481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7028ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7028b3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813011.906790:0:9481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a7b522000 from 1 10000000:01000000:3.0:1788813011.906792:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788813011.906825:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff7028c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.906833:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff7028c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.906845:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff7028c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813011.906867:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211136:0@lo:101: 00000100:00100000:3.0:1788813011.906927:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813011.906984:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313211136 00000100:00100000:3.0:1788813011.906989:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a467746c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813011.906993:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313211136 00000100:00100000:2.0:1788813011.907044:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788813011.907055:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:9481:x1875706313211136:12345-0@lo:101: 00010000:00010000:2.0:1788813011.907068:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813011.907080:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a821e5a00/0xf32533d6ff7028cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7028c8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.907103:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e5a00/0xf32533d6ff7028cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7028c8 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.907114:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a821e5a00/0xf32533d6ff7028cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7028c8 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.907123:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e5a00, rc 0) 00000100:00100000:2.0:1788813011.907167:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:9481:x1875706313211136:12345-0@lo:101: Request processed in 114us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.907183:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788813011.907225:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211136:0@lo:101: 00010000:00010000:3.0:1788813011.907241:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff7028c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7028cf expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.907251:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff7028c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7028cf expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813011.907321:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211264:0@lo:501: 00000100:00100000:3.0:1788813011.907344:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813011.907377:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a467746c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813011.907464:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313211264 00000100:00100000:2.0:1788813011.907469:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313211264 00000100:00100000:2.0:1788813011.907496:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788813011.907501:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:9481:x1875706313211264:12345-0@lo:501: 00000100:00100000:2.0:1788813011.907590:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:9481:x1875706313211264:12345-0@lo:501: Request processed in 89us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.907595:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788813011.907623:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211264:0@lo:501: 00000100:00100000:3.0:1788813011.907659:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211392:0@lo:503: 00000100:00100000:3.0:1788813011.907697:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813011.907715:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a467746c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813011.907731:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313211392 00000100:00100000:2.0:1788813011.907736:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313211392 00000100:00100000:2.0:1788813011.907757:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788813011.907763:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:9481:x1875706313211392:12345-0@lo:503: 00000100:00100000:2.0:1788813011.907846:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:9481:x1875706313211392:12345-0@lo:503: Request processed in 82us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813011.907865:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211392:0@lo:503: 00000100:00100000:2.0:1788813011.907867:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000040:00080000:3.0:1788813011.908121:0:9481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788813011.908192:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211520:0@lo:502: 00000100:00100000:3.0:1788813011.908232:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813011.908263:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a467746c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813011.908275:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313211520 00000100:00100000:2.0:1788813011.908281:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313211520 00000100:00100000:2.0:1788813011.908312:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788813011.908321:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:9481:x1875706313211520:12345-0@lo:502: 00000100:00100000:2.0:1788813011.908417:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:9481:x1875706313211520:12345-0@lo:502: Request processed in 96us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.908425:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788813011.908439:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211520:0@lo:502: 00000040:00080000:3.0:1788813011.908637:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788813011.908670:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788813011.908694:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211648:0@lo:502: 00000100:00100000:3.0:1788813011.908732:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813011.908753:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a467746c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813011.908779:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313211648 00000100:00100000:2.0:1788813011.908785:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313211648 00000100:00100000:2.0:1788813011.908814:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788813011.908823:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:9481:x1875706313211648:12345-0@lo:502: 00000100:00100000:2.0:1788813011.908918:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:9481:x1875706313211648:12345-0@lo:502: Request processed in 96us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.908926:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788813011.908960:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211648:0@lo:502: 00000040:00080000:3.0:1788813011.909005:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788813011.909016:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788813011.909444:0:9496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813011.909453:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813011.909456:0:9496:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788813011.909463:0:9496:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a7b522000 00000020:00000080:3.0:1788813011.909466:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788813011.909479:0:9496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813011.909483:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813011.909484:0:9496:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788813011.909487:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788813011.909551:0:9481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788813011.909580:0:9481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813011.909600:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff7028c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7028cf expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.909611:0:9481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff7028c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7028cf expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813011.909656:0:9481:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788813011.909659:0:9481:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff948a7b522000 10000000:01000000:0.0:1788813011.909662:0:9481:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff948a7b522000 10000000:01000000:0.0:1788813011.909666:0:9481:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788813011.909671:0:9481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a7b522000 from 1 10000000:01000000:0.0:1788813011.909673:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788813011.909696:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff7028d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.909704:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff7028d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.909713:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff7028d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813011.909727:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211776:0@lo:101: 00000100:00100000:0.0:1788813011.909757:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.909789:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813011.909813:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313211776 00000100:00100000:2.0:1788813011.909819:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313211776 00000100:00100000:2.0:1788813011.909854:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788813011.909863:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:9481:x1875706313211776:12345-0@lo:101: 00010000:00010000:2.0:1788813011.909873:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813011.909887:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a821e4e00/0xf32533d6ff7028dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7028d6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.909908:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e4e00/0xf32533d6ff7028dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7028d6 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.909919:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a821e4e00/0xf32533d6ff7028dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7028d6 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.909928:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4e00, rc 0) 00000100:00100000:2.0:1788813011.909994:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:9481:x1875706313211776:12345-0@lo:101: Request processed in 131us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.910002:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788813011.910006:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211776:0@lo:101: 00010000:00010000:0.0:1788813011.910021:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff7028d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7028dd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.910031:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff7028d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7028dd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813011.910099:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211904:0@lo:501: 00000100:00100000:0.0:1788813011.910123:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.910146:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813011.910166:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313211904 00000100:00100000:2.0:1788813011.910172:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313211904 00000100:00100000:2.0:1788813011.910213:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788813011.910222:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:9481:x1875706313211904:12345-0@lo:501: 00000100:00100000:2.0:1788813011.910313:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:9481:x1875706313211904:12345-0@lo:501: Request processed in 93us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.910320:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788813011.910383:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313211904:0@lo:501: 00000100:00100000:0.0:1788813011.910410:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313212032:0@lo:503: 00000100:00100000:0.0:1788813011.910442:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.910460:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813011.910485:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313212032 00000100:00100000:2.0:1788813011.910490:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313212032 00000100:00100000:2.0:1788813011.910532:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788813011.910541:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:9481:x1875706313212032:12345-0@lo:503: 00000100:00100000:2.0:1788813011.910632:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:9481:x1875706313212032:12345-0@lo:503: Request processed in 91us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.910640:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788813011.910659:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313212032:0@lo:503: 00000040:00080000:3.0:1788813011.910847:0:9481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788813011.910906:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313212160:0@lo:502: 00000100:00100000:3.0:1788813011.910972:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.910998:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313212160 00000100:00100000:0.0:1788813011.911003:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313212160 00000100:00100000:3.0:1788813011.911008:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46774d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813011.911034:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788813011.911043:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:9481:x1875706313212160:12345-0@lo:502: 00000100:00100000:0.0:1788813011.911138:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:9481:x1875706313212160:12345-0@lo:502: Request processed in 96us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813011.911145:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788813011.911246:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313212160:0@lo:502: 00000040:00080000:3.0:1788813011.911443:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788813011.911469:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788813011.911478:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788813011.911499:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788813011.911519:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788813011.911537:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788813011.911553:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788813011.911563:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788813011.911575:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788813011.911588:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788813011.911604:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788813011.911616:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788813011.911625:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788813011.911643:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788813011.911665:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788813011.911685:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788813011.911702:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788813011.911723:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788813011.911740:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788813011.911758:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788813011.911775:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788813011.911793:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788813011.911826:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788813011.911844:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788813011.911877:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788813011.911895:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788813011.911914:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788813011.911925:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788813011.911961:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788813011.911973:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788813011.911982:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788813011.911991:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788813011.912001:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788813011.912012:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788813011.912021:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788813011.912030:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788813011.912037:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1788813011.912061:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788813011.912089:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1788813011.912112:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1788813011.912124:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1788813011.912134:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1788813011.912142:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1788813011.912150:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1788813011.912160:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1788813011.912173:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788813011.912197:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313212288:0@lo:502: 00000100:00100000:3.0:1788813011.912241:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813011.912273:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46774d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813011.912331:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313212288 00000100:00100000:2.0:1788813011.912337:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313212288 00000100:00100000:2.0:1788813011.912380:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788813011.912388:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:9481:x1875706313212288:12345-0@lo:502: 00000100:00100000:2.0:1788813011.912486:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:9481:x1875706313212288:12345-0@lo:502: Request processed in 98us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.912493:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788813011.912566:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313212288:0@lo:502: 00000040:00080000:0.0:1788813011.912609:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1788813011.912615:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1788813011.912902:0:9497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788813011.912917:0:9497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff948a76538000) 00000020:00000080:3.0:1788813011.912969:0:9497:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1788813011.913055:0:9497:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a7b522000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788813011.913059:0:9497:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a7b522000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788813011.913062:0:9497:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7b522000 3 00010000:00080000:3.0:1788813011.913090:0:9497:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948942c22800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.113@tcp at head 00010000:00010000:3.0:1788813011.914724:0:9497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1788813011.914888:0:9497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788813011.914923:0:9497:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788813011.914957:0:9497:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf32533d6ff7028eb 00000100:00080000:3.0:1788813011.914967:0:9497:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788813011.914975:0:9497:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff948942c22800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813011.915005:0:9497:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a6eb03100 x1875706313212416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813011.915027:0:9497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788813011.915049:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313212416:0@lo:38: 00000100:00100000:0.0:1788813011.915103:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.915234:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313212544:0@lo:400: 00000100:00100000:0.0:1788813011.915270:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.915298:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313213056:0@lo:400: 00000100:00100000:2.0:1788813011.915305:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313212800:0@lo:400: 00000100:00100000:0.0:1788813011.915338:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.915382:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788813011.915383:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.915398:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313212928:0@lo:400: 00000100:00100000:2.0:1788813011.915409:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313213312:0@lo:400: 00000100:00100000:0.0:1788813011.915429:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813011.915444:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.915452:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313213440:0@lo:400: 00000100:00100000:2.0:1788813011.915469:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788813011.915476:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313212672:0@lo:400: 00000100:00100000:0.0:1788813011.915482:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813011.915511:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.915518:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313212416 00000100:00100000:0.0:1788813011.915525:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313212416 00000100:00100000:2.0:1788813011.915536:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313213184:0@lo:400: 00000100:00100000:0.0:1788813011.915545:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313212544 00000100:00100000:0.0:1788813011.915549:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313212544 00000100:00100000:2.0:1788813011.915566:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.915576:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313213056 00000100:00100000:0.0:1788813011.915580:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313213056 00000100:00100000:2.0:1788813011.915593:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313212800 00000100:00100000:2.0:1788813011.915598:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313212800 00000100:00100000:2.0:1788813011.915619:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313213184 00000100:00100000:2.0:1788813011.915621:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313213184 00000100:00100000:0.0:1788813011.915630:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788813011.915640:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313212544:12345-0@lo:400: 00000100:00100000:2.0:1788813011.915655:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788813011.915664:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313213056:12345-0@lo:400: 00000100:00100000:0.0:1788813011.915697:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313212544:12345-0@lo:400: Request processed in 57us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.915705:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313213056:12345-0@lo:400: Request processed in 43us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813011.915709:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788813011.915715:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788813011.915736:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788813011.915741:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313212800:12345-0@lo:400: 00000100:00100000:0.0:1788813011.915747:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813011.915754:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1875706313212416:12345-0@lo:38: 00000100:00100000:2.0:1788813011.915767:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313212800:12345-0@lo:400: Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.915772:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788813011.915777:0:6494:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000100:00100000:2.0:1788813011.915783:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788813011.915790:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313213184:12345-0@lo:400: 00000100:00100000:2.0:1788813011.915819:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313213184:12345-0@lo:400: Request processed in 30us (254us total) trans 0 rc 0/0 00000020:00000080:0.0:1788813011.915823:0:6494:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf32533d6ff7028f2 00000100:00100000:2.0:1788813011.915827:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00100000:0.0:1788813011.915840:0:6494:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788813011.915849:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313212928 00000100:00100000:2.0:1788813011.915854:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313212928 00000100:00080000:0.0:1788813011.915872:0:6494:0:(import.c:65:import_set_state_nolock()) ffff948a6ebc8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813011.915873:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313212672 00000100:00100000:2.0:1788813011.915877:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313212672 00000100:00100000:2.0:1788813011.915889:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788813011.915895:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313212928:12345-0@lo:400: 00000100:00100000:2.0:1788813011.916052:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313212928:12345-0@lo:400: Request processed in 157us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.916056:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788813011.916065:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788813011.916070:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313212672:12345-0@lo:400: 00000100:00100000:2.0:1788813011.916091:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313212672:12345-0@lo:400: Request processed in 22us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.916103:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788813011.916120:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788813011.916123:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813011.916148:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313212672:0@lo:400: 00010000:00080000:2.0:1788813011.916162:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76405c00 x1875706313213184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813011.916171:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313213184:0@lo:400: 00010000:00080000:2.0:1788813011.916182:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76405180 x1875706313212800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813011.916190:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313212800:0@lo:400: 00000100:00100000:0.0:1788813011.916224:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875706313212416:12345-0@lo:38: Request processed in 467us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813011.916232:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788813011.916269:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6eb03100 x1875706313212416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813011.916278:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788813011.916291:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788813011.916298:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788813011.916302:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788813011.916305:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948942c22800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788813011.916311:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313212416:0@lo:38: 00000100:00100000:0.0:1788813011.916337:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313212928:0@lo:400: 00010000:00080000:0.0:1788813011.916347:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76406300 x1875706313213056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813011.916356:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313213056:0@lo:400: 00010000:00080000:0.0:1788813011.916378:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76407b80 x1875706313212544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813011.916387:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313212544:0@lo:400: 00000100:00100000:1.0:1788813011.917157:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313213312 00000100:00100000:1.0:1788813011.917165:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313213312 00000100:00100000:1.0:1788813011.917214:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313213440 00000100:00100000:1.0:1788813011.917218:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313213440 00000100:00100000:1.0:1788813011.917239:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813011.917246:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313213312:12345-0@lo:400: 00000100:00100000:1.0:1788813011.917354:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313213312:12345-0@lo:400: Request processed in 109us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813011.917371:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813011.917385:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788813011.917393:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813011.917394:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313213440:12345-0@lo:400: 00000100:00100000:1.0:1788813011.917438:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313213440:12345-0@lo:400: Request processed in 47us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813011.917444:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788813011.917467:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76406680 x1875706313213440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813011.917476:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313213440:0@lo:400: 00010000:00080000:1.0:1788813011.917564:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a76405880 x1875706313213312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813011.917575:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313213312:0@lo:400: 00000020:01000004:3.0:1788813011.917728:0:9497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:0.0:1788813011.917738:0:9499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a89d500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9499:1875706313213568:0@lo:901: 00000020:00000080:3.0:1788813011.917742:0:9497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff948a765399c0) 00000020:00000080:3.0:1788813011.917766:0:9497:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:0.0:1788813011.917774:0:9499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813011.917801:0:9499:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813011.917821:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313213568 00000100:00100000:1.0:1788813011.917826:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313213568 00000020:01000004:3.0:1788813011.917841:0:9497:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a7b522000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788813011.917846:0:9497:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a7b522000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788813011.917850:0:9497:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7b522000 3 00010000:00080000:3.0:1788813011.917877:0:9497:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948942016000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.113@tcp at head 00000100:00100000:1.0:1788813011.918250:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813011.918299:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9499:x1875706313213568:12345-0@lo:901: 00000100:00100000:1.0:1788813011.918435:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9499:x1875706313213568:12345-0@lo:901: Request processed in 137us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813011.918441:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788813011.918457:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788813011.918498:0:9499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6a89d500 x1875706313213568/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788813027 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813011.918509:0:9499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a89d500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9499:1875706313213568:0@lo:901: 00010000:00010000:3.0:1788813011.920018:0:9497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1788813011.920204:0:9497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788813011.920241:0:9497:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788813011.920253:0:9497:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf32533d6ff702900 00000100:00080000:3.0:1788813011.920261:0:9497:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788813011.920270:0:9497:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff948942016000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813011.920298:0:9497:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a6eb02a00 x1875706313213696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813011.920326:0:9497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1788813011.922379:0:9497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:0.0:1788813011.923382:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1875706313213696:0@lo:38: 00000100:00100000:0.0:1788813011.923449:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788813011.923518:0:9481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 00000100:00100000:2.0:1788813011.923538:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313213696 00000100:00100000:2.0:1788813011.923546:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313213696 10000000:01000000:0.0:1788813011.923550:0:9481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788813011.923573:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff7028d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7028dd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.923576:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813011.923584:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3624:x1875706313213696:12345-0@lo:38: 00010000:00010000:0.0:1788813011.923592:0:9481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff7028d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7028dd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788813011.923642:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788813011.923644:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788813011.923645:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813011.923647:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813011.923648:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813011.923649:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813011.923651:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788813011.923652:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788813011.923654:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788813011.923655:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813011.923657:0:9481:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788813011.923660:0:9481:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788813011.923663:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788813011.923664:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788813011.923665:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813011.923667:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813011.923669:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813011.923670:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813011.923672:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788813011.923673:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788813011.923675:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788813011.923677:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813011.923678:0:9481:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788813011.923695:0:9481:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00010000:00080000:2.0:1788813011.923699:0:9156:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000100:00100000:0.0:1788813011.923710:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a89c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313213824:0@lo:253: 00000020:00000080:2.0:1788813011.923732:0:9156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf32533d6ff702907 00000004:00100000:2.0:1788813011.923745:0:9156:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788813011.923754:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788813011.923769:0:9156:0:(import.c:65:import_set_state_nolock()) ffff948943009000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813011.923776:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813011.923797:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313213824 00000100:00100000:0.0:1788813011.923808:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313213824 00000100:00100000:2.0:1788813011.923823:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875706313213696:12345-0@lo:38: Request processed in 237us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.923831:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813011.923853:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788813011.923861:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:9481:x1875706313213824:12345-0@lo:253: 20000000:01000000:0.0:1788813011.923881:0:6488:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788813011.923894:0:6488:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1788813011.924038:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a6eb02a00 x1875706313213696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813011.924047:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788813011.924054:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788813011.924060:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788813011.924064:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788813011.924066:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948942016000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788813011.924071:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1875706313213696:0@lo:38: 20000000:01000000:2.0:1788813011.929591:0:6488:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788813011.929606:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788813011.929624:0:6510:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788813011.929631:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788813011.929652:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70290e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.929671:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a4166f400/0xf32533d6ff7027e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7027e1 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.929679:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a44cda800/0xf32533d6ff70283c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702835 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.929686:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70290e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.929723:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a44cda800/0xf32533d6ff70283c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702835 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.929746:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a44cda800/0xf32533d6ff70283c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702835 expref: 17 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813011.929760:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a89df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6510:1875706313213952:0@lo:104: 00000100:00100000:0.0:1788813011.929823:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813011.929859:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:9481:x1875706313213824:12345-0@lo:253: Request processed in 5997us (6102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.929877:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00010000:0.0:1788813011.929887:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a4166f400/0xf32533d6ff7027e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7027e1 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.929898:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a4166f400/0xf32533d6ff7027e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7027e1 expref: 16 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813011.929911:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a89f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6510:1875706313214080:0@lo:104: 00000100:00100000:1.0:1788813011.929912:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a89c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:064264df-8ee4-4cbf-a8c5-6a62aca32881:9481:1875706313213824:0@lo:253: 10000000:01000000:1.0:1788813011.929951:0:9481:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788813011.929955:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788813011.929958:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788813011.929960:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813011.929965:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:0.0:1788813011.929965:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1788813011.929968:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813011.929971:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813011.929973:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813011.929975:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788813011.929976:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788813011.929978:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813011.929980:0:9481:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788813011.929991:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb780 going to sleep for 11 seconds 00000020:02000000:1.0:1788813011.929995:0:9481:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788813011.930006:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313213952 00000100:00100000:2.0:1788813011.930013:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313213952 00000100:00100000:2.0:1788813011.930045:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313214080 00000100:00100000:2.0:1788813011.930048:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313214080 00000100:00100000:2.0:1788813011.930061:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788813011.930069:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6510:x1875706313213952:12345-0@lo:104: 00010000:00010000:2.0:1788813011.930082:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a4151c200/0xf32533d6ff702835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70283c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.930132:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788813011.930139:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:6510:x1875706313213952:12345-0@lo:104: Request processed in 71us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813011.930146:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788813011.930152:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a89df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6510:1875706313213952:0@lo:104: 00000100:00100000:2.0:1788813011.930177:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813011.930186:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6510:x1875706313214080:12345-0@lo:104: 00010000:00010000:2.0:1788813011.930194:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a821e5400/0xf32533d6ff7027e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7027e8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.930236:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788813011.930242:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:6510:x1875706313214080:12345-0@lo:104: Request processed in 57us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813011.930243:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a89f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6510:1875706313214080:0@lo:104: 00000100:00100000:2.0:1788813011.930257:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788813011.930268:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70290e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.930279:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788813011.930287:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a4151c200/0xf32533d6ff702835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70283c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.930295:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4151c200 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:2.0:1788813011.930305:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a4151c200/0xf32533d6ff702835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff70283c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.930314:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4151c200/0xf32533d6ff702835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff70283c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813011.930321:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4151c200/0xf32533d6ff702835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff70283c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813011.930327:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788813011.930370:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a4151c200/0xf32533d6ff702835 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70283c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.930378:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813011.930399:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a4151c200/0xf32533d6ff702835 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70283c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813011.930406:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313214208:0@lo:103: 00000100:00100000:0.0:1788813011.930434:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813011.930472:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4151c200/0xf32533d6ff702835 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70283c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.930485:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813011.930488:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a821e5400/0xf32533d6ff7027e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7027e8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.930494:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5400 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:2.0:1788813011.930497:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a821e5400/0xf32533d6ff7027e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7027e8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.930503:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a821e5400/0xf32533d6ff7027e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7027e8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813011.930521:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a821e5400/0xf32533d6ff7027e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7027e8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813011.930527:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788813011.930548:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a821e5400/0xf32533d6ff7027e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7027e8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.930555:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813011.930575:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a821e5400/0xf32533d6ff7027e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7027e8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813011.930580:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313214336:0@lo:103: 00010000:00010000:2.0:1788813011.930586:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a821e5400/0xf32533d6ff7027e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7027e8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813011.930601:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813011.930603:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813011.930606:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813011.930611:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813011.930613:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813011.930632:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313214208 00000100:00100000:3.0:1788813011.930637:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313214208 00010000:00010000:3.0:1788813011.930676:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a44cda800/0xf32533d6ff70283c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702835 expref: 17 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813011.930699:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313214336 00000100:00100000:3.0:1788813011.930703:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313214336 00000100:00100000:0.0:1788813011.930711:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1788813011.930717:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a4166f400/0xf32533d6ff7027e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7027e1 expref: 18 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813011.930724:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:3628:x1875706313214208:12345-0@lo:103: 00010000:00010000:0.0:1788813011.930737:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788813011.930746:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788813011.930752:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a44cda800/0xf32533d6ff70283c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702835 expref: 18 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.930754:0:6478:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788813011.930757:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:3625:x1875706313214336:12345-0@lo:103: 00000100:00100000:2.0:1788813011.930764:0:6478:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:3.0:1788813011.930770:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813011.930775:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a44cda800/0xf32533d6ff70283c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702835 expref: 18 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.930777:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a4166f400/0xf32533d6ff7027e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7027e1 expref: 18 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.930801:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cda800/0xf32533d6ff70283c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702835 expref: 18 pid: 6486 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.930804:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a4166f400/0xf32533d6ff7027e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7027e1 expref: 18 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.930823:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a4166f400/0xf32533d6ff7027e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7027e1 expref: 17 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.930826:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70290e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.930836:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70290e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.930844:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 20000000:01000000:0.0:1788813011.930848:0:6480:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007561820s 00010000:00010000:0.0:1788813011.930854:0:6480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70290e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.930862:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70290e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.930869:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70290e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.930876:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70290e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813011.930883:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:3625:x1875706313214336:12345-0@lo:103: Request processed in 127us (270us total) trans 0 rc 0/0 00010000:00010000:0.0:1788813011.930887:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdaa00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813011.930895:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70290e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813011.930898:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788813011.930908:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70290e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813011.930910:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313214336:0@lo:103: 00010000:00010000:0.0:1788813011.930972:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70290e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813011.930982:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813011.931027:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:3628:x1875706313214208:12345-0@lo:103: Request processed in 307us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813011.931034:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788813011.931103:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313214208:0@lo:103: 00010000:00010000:3.0:1788813011.933675:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70290e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.933692:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70290e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813011.933699:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cdaa00/0xf32533d6ff70290e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788813011.934695:0:9481:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788813011.934854:0:9481:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788813011.935070:0:9481:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788813011.935224:0:9481:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788813011.935509:0:9481:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788813011.935718:0:9481:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788813011.937549:0:9481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788813011.948241:0:9481:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788813011.948253:0:9481:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788813011.948298:0:9481:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788813011.948345:0:9481:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788813011.948385:0:9481:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788813011.948422:0:9481:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788813011.949951:0:9481:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788813011.950131:0:9481:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:2.0:1788813012.500348:0:9555:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813012.501815:0:9555:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788813012.841437:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813013.860235:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788813013.860242:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813013.860271:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a89c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313214464:0@lo:13: 00000100:00100000:2.0:1788813013.861213:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813013.861272:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313214464 00000100:00100000:0.0:1788813013.861283:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313214464 00000100:00100000:3.0:1788813013.861450:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313214592:0@lo:13: 00000100:00100000:3.0:1788813013.861485:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813013.861491:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313214592 00000100:00100000:0.0:1788813013.861495:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313214592 00000100:00080000:1.0:1788813013.861531:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813013.861578:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813013.861591:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1875706313214464:12345-0@lo:13: 00002000:00000024:1.0:1788813013.861628:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813013.861682:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1875706313214464:12345-0@lo:13: Request processed in 94us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813013.861689:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788813013.861996:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a6a89c000 x1875706313214464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813013.862019:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a89c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313214464:0@lo:13: 00000100:00100000:0.0:1788813013.862080:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813013.862089:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313214592:12345-0@lo:13: 00002000:00000024:0.0:1788813013.862101:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813013.862136:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313214592:12345-0@lo:13: Request processed in 49us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813013.862141:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788813013.862211:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a6eb02300 x1875706313214592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813013.862224:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313214592:0@lo:13: 00010000:00010000:3.0:1788813014.884867:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813014.885617:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a89ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313214720:0@lo:41: 00000100:00100000:3.0:1788813014.885692:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813014.885899:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313214720 00000100:00100000:3.0:1788813014.885908:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313214720 00000100:00100000:3.0:1788813014.886021:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788813014.886032:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313214720:12345-0@lo:41: 00000004:00000024:3.0:1788813014.886068:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788813014.886125:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313214720:12345-0@lo:41: Request processed in 94us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813014.886132:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788813014.886237:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a89ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313214720:0@lo:41: 00000001:00080000:0.0:1788813014.893501:0:8399:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:02000400:2.0:1788813015.360861:0:9845:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788813015.397077:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313214848:0@lo:41: 00000100:00100000:0.0:1788813015.397146:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813015.397344:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313214848 00000100:00100000:1.0:1788813015.397351:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313214848 00000100:00100000:1.0:1788813015.397396:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788813015.397402:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313214848:12345-0@lo:41: 00000004:00000024:1.0:1788813015.397430:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788813015.397479:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313214848:12345-0@lo:41: Request processed in 76us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813015.397486:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788813015.397528:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313214848:0@lo:41: 00010000:00010000:0.0:1788813015.908393:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788813015.916362:0:9897:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788813015.916604:0:9897:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788813016.932370:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813016.932463:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a89c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313214976:0@lo:400: 00000100:00100000:2.0:1788813016.932595:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313215360:0@lo:400: 00000100:00100000:3.0:1788813016.932956:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a89c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313215104:0@lo:400: 00000100:00100000:0.0:1788813016.933488:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313215232:0@lo:400: 00000100:00100000:0.0:1788813016.933522:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813016.933559:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313215744:0@lo:400: 00000100:00100000:0.0:1788813016.933774:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813016.933790:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313216256:0@lo:400: 00000100:00100000:0.0:1788813016.933803:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813016.933831:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313215232 00000100:00100000:0.0:1788813016.933837:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313215232 00000100:00100000:0.0:1788813016.933870:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788813016.933876:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313215232:12345-0@lo:400: 00000100:00100000:0.0:1788813016.933915:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313215232:12345-0@lo:400: Request processed in 40us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813016.933920:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788813016.933953:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313215744 00000100:00100000:0.0:1788813016.933955:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313215744 00000100:00100000:0.0:1788813016.933979:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313216256 00000100:00100000:0.0:1788813016.933981:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313216256 00000100:00100000:0.0:1788813016.933992:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813016.933996:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313215744:12345-0@lo:400: 00000100:00100000:0.0:1788813016.934015:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313215744:12345-0@lo:400: Request processed in 19us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813016.934019:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813016.934026:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788813016.934029:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313216256:12345-0@lo:400: 00000100:00100000:0.0:1788813016.934053:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313216256:12345-0@lo:400: Request processed in 24us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813016.934057:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788813016.934071:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813016.934092:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313215232:0@lo:400: 00010000:00080000:0.0:1788813016.934101:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a764caa00 x1875706313215744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813016.934107:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313215744:0@lo:400: 00010000:00080000:0.0:1788813016.934112:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a764c8380 x1875706313216256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813016.934117:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313216256:0@lo:400: 00000100:00100000:1.0:1788813016.934322:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813016.934344:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313215488:0@lo:400: 00000100:00100000:1.0:1788813016.934365:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813016.934400:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313216000:0@lo:400: 00000100:00100000:1.0:1788813016.934428:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813016.934459:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313216000 00000100:00100000:1.0:1788813016.934462:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313216000 00000100:00100000:1.0:1788813016.934490:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813016.934497:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313216000:12345-0@lo:400: 00000100:00100000:1.0:1788813016.934526:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313216000:12345-0@lo:400: Request processed in 31us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813016.934530:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788813016.934550:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a764cad80 x1875706313216000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813016.934555:0:3626:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788813016.934644:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313216000:0@lo:400: 00000100:00100000:0.0:1788813016.935651:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313214976 00000100:00100000:0.0:1788813016.935657:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313214976 00000100:00100000:0.0:1788813016.935700:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788813016.935705:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:3626:x1875706313214976:12345-0@lo:400: 00000100:00100000:0.0:1788813016.935740:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:3626:x1875706313214976:12345-0@lo:400: Request processed in 36us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813016.935744:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1788813016.935764:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813016.935770:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313215488 00000100:00100000:0.0:1788813016.935772:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313215488 00000100:00100000:0.0:1788813016.935785:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788813016.935788:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313215488:12345-0@lo:400: 00000100:00100000:0.0:1788813016.935807:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313215488:12345-0@lo:400: Request processed in 19us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813016.935819:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788813016.936131:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813016.936160:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313215872:0@lo:400: 00000100:00100000:2.0:1788813016.936177:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813016.936200:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313215872 00000100:00100000:2.0:1788813016.936203:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313215872 00000100:00100000:2.0:1788813016.936223:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813016.936227:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313215872:12345-0@lo:400: 00000100:00100000:2.0:1788813016.936249:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313215872:12345-0@lo:400: Request processed in 21us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813016.936554:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313215360 00000100:00100000:0.0:1788813016.936558:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313215360 00000100:00100000:0.0:1788813016.936630:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788813016.936634:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313215360:12345-0@lo:400: 00000100:00100000:0.0:1788813016.936658:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313215360:12345-0@lo:400: Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813016.936662:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788813016.936732:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788813016.936759:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a764ca300 x1875706313215360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813016.936768:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313215360:0@lo:400: 00010000:00080000:2.0:1788813016.936774:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a764cbb80 x1875706313215872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813016.936779:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313215872:0@lo:400: 00000100:00080000:0.0:1788813016.936823:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813016.937365:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a89c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313214976:0@lo:400: 00000100:00100000:1.0:1788813016.937380:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313215488:0@lo:400: 00000100:00100000:3.0:1788813016.937567:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813016.937606:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313215616:0@lo:400: 00000100:00100000:0.0:1788813016.937618:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313215104 00000100:00100000:0.0:1788813016.937625:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313215104 00000100:00100000:3.0:1788813016.937653:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813016.937685:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313216128:0@lo:400: 00000100:00100000:3.0:1788813016.938054:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813016.938607:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313215616 00000100:00100000:0.0:1788813016.938613:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313215616 00000100:00100000:1.0:1788813016.938617:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313216128 00000100:00100000:1.0:1788813016.938623:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313216128 00000100:00100000:0.0:1788813016.938654:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788813016.938662:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788813016.938667:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313215104:12345-0@lo:400: 00000100:00100000:1.0:1788813016.938671:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788813016.938675:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313215616:12345-0@lo:400: 00000100:00100000:1.0:1788813016.938679:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313216128:12345-0@lo:400: 00000100:00100000:3.0:1788813016.938716:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313215616:12345-0@lo:400: Request processed in 45us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813016.938716:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313216128:12345-0@lo:400: Request processed in 36us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813016.938723:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788813016.938726:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788813016.938749:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788813016.938754:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a764c9c00 x1875706313215616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813016.938765:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313215616:0@lo:400: 00010000:00080000:3.0:1788813016.938775:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a764c8700 x1875706313216128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813016.938783:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313216128:0@lo:400: 00000100:00100000:0.0:1788813016.939346:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313215104:12345-0@lo:400: Request processed in 683us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813016.939355:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788813016.939375:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a6a89c700 x1875706313215104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813016.939382:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a89c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313215104:0@lo:400: 00000020:00000004:1.0:1788813017.896486:0:9998:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788813017.896649:0:9998:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788813017.959843:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788813018.411590:0:10046:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788813018.411608:0:10046:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788813018.980573:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813018.980581:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313216512:0@lo:13: 00000100:00100000:1.0:1788813018.980644:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813018.980723:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813018.980729:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313216384:0@lo:13: 00000100:00100000:1.0:1788813018.980752:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813018.980952:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313216512 00000100:00100000:0.0:1788813018.980960:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313216512 00000100:00100000:0.0:1788813018.981011:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313216384 00000100:00100000:0.0:1788813018.981014:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313216384 00000100:00100000:0.0:1788813018.981034:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813018.981042:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313216512:12345-0@lo:13: 00002000:00000024:0.0:1788813018.981071:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813018.981174:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313216512:12345-0@lo:13: Request processed in 132us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813018.981198:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813018.981218:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788813018.981224:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313216384:12345-0@lo:13: 00002000:00000024:0.0:1788813018.981233:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813018.981269:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313216384:12345-0@lo:13: Request processed in 45us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813018.981274:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788813018.981387:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788813018.981597:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a764c8380 x1875706313216512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813018.981615:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313216512:0@lo:13: 00010000:00080000:2.0:1788813018.981640:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a71412a00 x1875706313216384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813018.981651:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313216384:0@lo:13: 00000100:00100000:0.0:1788813019.727705:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813019.728641:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301645184 00000100:00100000:2.0:1788813019.728653:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301645184 00000100:00100000:2.0:1788813019.728714:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 138 00000100:00100000:2.0:1788813019.728723:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2395:x1875706301645184:12345-192.168.202.13@tcp:250: 00010000:00080000:2.0:1788813019.728751:0:6488:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 612bc516-9aee-451d-b7c0-359fff7db073@192.168.202.13@tcp t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:2.0:1788813019.728779:0:6488:0:(genops.c:1384:class_connect()) connect: client 612bc516-9aee-451d-b7c0-359fff7db073, cookie 0xf32533d6ff702915 00000100:00080000:2.0:1788813019.728922:0:6488:0:(import.c:65:import_set_state_nolock()) ffff948941924000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813019.729021:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+5:2395:x1875706301645184:12345-192.168.202.13@tcp:250: Request processed in 297us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813019.729030:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 138 00000100:00100000:0.0:1788813019.733824:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813019.733924:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301645056 00000100:00100000:1.0:1788813019.733964:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301645056 00000100:00100000:1.0:1788813019.734033:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 139 00000100:00100000:1.0:1788813019.734043:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+5:6144:x1875706301645056:12345-192.168.202.13@tcp:101: 00010000:00010000:1.0:1788813019.734060:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813019.734086:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8800/0xf32533d6ff70291c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729554 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813019.734114:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8800/0xf32533d6ff70291c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729554 expref: 6 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813019.734127:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8800/0xf32533d6ff70291c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729554 expref: 6 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813019.734135:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8800, rc 0) 00000100:00100000:1.0:1788813019.734193:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+6:6144:x1875706301645056:12345-192.168.202.13@tcp:101: Request processed in 151us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813019.734200:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 139 00000100:00100000:3.0:1788813019.736155:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813019.736351:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301645312 00000100:00100000:0.0:1788813019.736359:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301645312 00000100:00100000:0.0:1788813019.736409:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 140 00000100:00100000:0.0:1788813019.736423:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+6:6144:x1875706301645312:12345-192.168.202.13@tcp:501: 00000100:00100000:0.0:1788813019.736576:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+6:6144:x1875706301645312:12345-192.168.202.13@tcp:501: Request processed in 154us (428us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813019.736584:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 140 00000100:00100000:0.0:1788813019.739870:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813019.740023:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301645440 00000100:00100000:2.0:1788813019.740033:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301645440 00000100:00100000:2.0:1788813019.740122:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 141 00000100:00100000:2.0:1788813019.740132:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+6:6144:x1875706301645440:12345-192.168.202.13@tcp:101: 00010000:00010000:2.0:1788813019.740149:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813019.740165:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a821e4200/0xf32533d6ff702923 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a072955b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.740191:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e4200/0xf32533d6ff702923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072955b expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.740202:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a821e4200/0xf32533d6ff702923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072955b expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.740212:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4200, rc 0) 00000100:00100000:2.0:1788813019.740273:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+7:6144:x1875706301645440:12345-192.168.202.13@tcp:101: Request processed in 142us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813019.740279:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 141 00000100:00100000:2.0:1788813019.741991:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813019.742249:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301645568 00000100:00100000:1.0:1788813019.742317:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301645568 00000100:00100000:1.0:1788813019.742386:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 142 00000100:00100000:1.0:1788813019.742392:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+7:6144:x1875706301645568:12345-192.168.202.13@tcp:501: 00000100:00100000:1.0:1788813019.742534:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+8:6144:x1875706301645568:12345-192.168.202.13@tcp:501: Request processed in 141us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813019.742542:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 142 00000100:00100000:3.0:1788813019.745356:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813019.745451:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301645696 00000100:00100000:2.0:1788813019.745461:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301645696 00000100:00100000:2.0:1788813019.745512:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 143 00000100:00100000:2.0:1788813019.745522:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+8:6144:x1875706301645696:12345-192.168.202.13@tcp:503: 00000100:00100000:2.0:1788813019.745653:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+8:6144:x1875706301645696:12345-192.168.202.13@tcp:503: Request processed in 132us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813019.745661:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 143 00000100:00100000:3.0:1788813019.748563:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813019.748842:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301645824 00000100:00100000:1.0:1788813019.748853:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301645824 00000100:00100000:1.0:1788813019.748910:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 144 00000100:00100000:1.0:1788813019.748920:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+8:6162:x1875706301645824:12345-192.168.202.13@tcp:502: 00000100:00100000:1.0:1788813019.749133:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+8:6162:x1875706301645824:12345-192.168.202.13@tcp:502: Request processed in 213us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813019.749141:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 144 00000100:00100000:3.0:1788813019.781104:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813019.781276:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301645952 00000100:00100000:0.0:1788813019.781296:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301645952 00000100:00100000:0.0:1788813019.781365:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 145 00000100:00100000:0.0:1788813019.781377:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+8:6162:x1875706301645952:12345-192.168.202.13@tcp:502: 00000100:00100000:0.0:1788813019.781523:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+8:6162:x1875706301645952:12345-192.168.202.13@tcp:502: Request processed in 148us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813019.781528:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 145 00000100:00100000:3.0:1788813019.792904:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813019.794846:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301646080 00000100:00100000:2.0:1788813019.794863:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301646080 00000100:00100000:2.0:1788813019.794959:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 146 00000100:00100000:2.0:1788813019.794970:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+8:6144:x1875706301646080:12345-192.168.202.13@tcp:101: 00010000:00010000:2.0:1788813019.794987:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813019.795008:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a821e5400/0xf32533d6ff70292a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a072958c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.795037:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e5400/0xf32533d6ff70292a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072958c expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.795048:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a821e5400/0xf32533d6ff70292a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072958c expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.795057:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e5400, rc 0) 00000100:00100000:2.0:1788813019.795175:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+9:6144:x1875706301646080:12345-192.168.202.13@tcp:101: Request processed in 207us (2284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813019.795182:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 146 00000100:00100000:3.0:1788813019.797826:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813019.797977:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301646208 00000100:00100000:0.0:1788813019.797994:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301646208 00000100:00100000:0.0:1788813019.798050:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 147 00000100:00100000:0.0:1788813019.798062:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+9:6144:x1875706301646208:12345-192.168.202.13@tcp:256: 20000000:01000000:0.0:1788813019.798086:0:6487:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788813019.798101:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788813019.798103:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788813019.798105:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788813019.798107:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788813019.798109:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788813019.800635:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+9:6144:x1875706301646208:12345-192.168.202.13@tcp:256: Request processed in 2564us (2809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813019.800647:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 147 00000100:00100000:3.0:1788813019.803323:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813019.803425:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301646336 00000100:00100000:1.0:1788813019.803434:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301646336 00000100:00100000:1.0:1788813019.803525:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 148 00000100:00100000:1.0:1788813019.803532:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+9:6144:x1875706301646336:12345-192.168.202.13@tcp:101: 00010000:00010000:1.0:1788813019.803547:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813019.803561:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f9c00/0xf32533d6ff702931 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729593 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813019.803583:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f9c00/0xf32533d6ff702931 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729593 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813019.803591:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f9c00/0xf32533d6ff702931 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729593 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813019.803609:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9c00, rc 0) 00000100:00100000:1.0:1788813019.803659:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:6144:x1875706301646336:12345-192.168.202.13@tcp:101: Request processed in 126us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813019.803680:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 148 00000100:00100000:3.0:1788813019.806053:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813019.806192:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301646464 00000100:00100000:0.0:1788813019.806198:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301646464 00000100:00100000:0.0:1788813019.806276:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 149 00000100:00100000:0.0:1788813019.806295:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+10:6144:x1875706301646464:12345-192.168.202.13@tcp:501: 00000100:00100000:0.0:1788813019.806410:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+10:6144:x1875706301646464:12345-192.168.202.13@tcp:501: Request processed in 126us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813019.806416:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 149 00000100:00100000:3.0:1788813019.807562:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813019.807624:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301646592 00000100:00100000:1.0:1788813019.807630:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301646592 00000100:00100000:1.0:1788813019.807670:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 150 00000100:00100000:1.0:1788813019.807676:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:6144:x1875706301646592:12345-192.168.202.13@tcp:503: 00000100:00100000:1.0:1788813019.807764:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:6144:x1875706301646592:12345-192.168.202.13@tcp:503: Request processed in 87us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813019.807771:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 150 00000100:00100000:3.0:1788813019.810167:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813019.810477:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301646720 00000100:00100000:0.0:1788813019.810487:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301646720 00000100:00100000:0.0:1788813019.810540:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 151 00000100:00100000:0.0:1788813019.810550:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+10:6169:x1875706301646720:12345-192.168.202.13@tcp:502: 00000100:00100000:0.0:1788813019.810699:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+10:6169:x1875706301646720:12345-192.168.202.13@tcp:502: Request processed in 150us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813019.810707:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 151 00000100:00100000:3.0:1788813019.812852:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813019.813089:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301646848 00000100:00100000:2.0:1788813019.813098:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301646848 00000100:00100000:2.0:1788813019.813149:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 152 00000100:00100000:2.0:1788813019.813170:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+10:6169:x1875706301646848:12345-192.168.202.13@tcp:502: 00000100:00100000:2.0:1788813019.815258:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+10:6169:x1875706301646848:12345-192.168.202.13@tcp:502: Request processed in 2068us (2392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813019.815273:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 152 00000100:00100000:3.0:1788813019.818587:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813019.819124:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301646976 00000100:00100000:1.0:1788813019.819132:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301646976 00000100:00100000:1.0:1788813019.819171:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:1.0:1788813019.819180:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1875706301646976:12345-192.168.202.13@tcp:38: 00010000:00080000:1.0:1788813019.819211:0:6494:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:1.0:1788813019.819260:0:6494:0:(genops.c:1384:class_connect()) connect: client d2fa4f95-78d4-4e44-8582-bb12ec2edfd4, cookie 0xf32533d6ff702938 00000004:00100000:1.0:1788813019.819294:0:6494:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788813019.819496:0:6494:0:(import.c:65:import_set_state_nolock()) ffff948942c7e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813019.819552:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2395:x1875706301646976:12345-192.168.202.13@tcp:38: Request processed in 373us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813019.819559:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:3.0:1788813019.820434:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813019.820692:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301647232 00000100:00100000:1.0:1788813019.820698:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301647232 00000100:00100000:1.0:1788813019.820735:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:1.0:1788813019.820740:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1875706301647232:12345-192.168.202.13@tcp:38: 00010000:00080000:1.0:1788813019.820763:0:6496:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:1.0:1788813019.820800:0:6496:0:(genops.c:1384:class_connect()) connect: client d2fa4f95-78d4-4e44-8582-bb12ec2edfd4, cookie 0xf32533d6ff70293f 00000004:00100000:1.0:1788813019.820827:0:6496:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788813019.821155:0:6496:0:(import.c:65:import_set_state_nolock()) ffff948a61041000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813019.821203:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2395:x1875706301647232:12345-192.168.202.13@tcp:38: Request processed in 461us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813019.821210:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 8 00010000:00010000:0.0:1788813020.004086:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813020.004496:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313216640:0@lo:41: 00000100:00100000:3.0:1788813020.004568:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813020.004647:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313216640 00000100:00100000:1.0:1788813020.004656:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313216640 00000100:00100000:1.0:1788813020.004709:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788813020.004716:0:6500:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788813020.004719:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313216640:12345-0@lo:41: 00000100:00100000:2.0:1788813020.004724:0:6500:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:1.0:1788813020.004752:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788813020.007102:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313216640:12345-0@lo:41: Request processed in 2374us (2523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813020.007115:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788813020.007136:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313216640:0@lo:41: 00000100:00100000:0.0:1788813020.516693:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71410700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313216768:0@lo:41: 00000100:00100000:0.0:1788813020.516759:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813020.518680:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313216768 00000100:00100000:2.0:1788813020.518691:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313216768 00000100:00100000:2.0:1788813020.518747:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788813020.518754:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313216768:12345-0@lo:41: 00000004:00000024:2.0:1788813020.518783:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788813020.519445:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313216768:12345-0@lo:41: Request processed in 688us (2682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813020.519451:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788813020.520763:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71410700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313216768:0@lo:41: 00000100:00100000:0.0:1788813020.825069:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813020.825147:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813020.826397:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813020.827496:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301647360 00000100:00100000:1.0:1788813020.827507:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301647360 00000100:00100000:1.0:1788813020.827592:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:1.0:1788813020.827603:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:0:x1875706301647360:12345-192.168.202.13@tcp:41: 00000004:00000024:1.0:1788813020.827634:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788813020.827694:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:0:x1875706301647360:12345-192.168.202.13@tcp:41: Request processed in 93us (2547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813020.827701:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00080000:2.0:1788813020.828022:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788813020.828211:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301647104 00000100:00100000:1.0:1788813020.828216:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301647104 00000100:00100000:1.0:1788813020.828406:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:1.0:1788813020.828414:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:0:x1875706301647104:12345-192.168.202.13@tcp:41: 00000004:00000024:1.0:1788813020.828429:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788813020.828466:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:0:x1875706301647104:12345-192.168.202.13@tcp:41: Request processed in 53us (2073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813020.828483:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:3.0:1788813020.828886:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301647488 00000100:00100000:3.0:1788813020.828891:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301647488 00000100:00100000:3.0:1788813020.830685:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:3.0:1788813020.830702:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:6144:x1875706301647488:12345-192.168.202.13@tcp:41: 00000004:00000024:3.0:1788813020.830746:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788813020.830817:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:6144:x1875706301647488:12345-192.168.202.13@tcp:41: Request processed in 122us (5762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813020.830825:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00080000:2.0:1788813020.830843:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813020.832553:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813020.832635:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301647616 00000100:00100000:1.0:1788813020.832644:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301647616 00000100:00100000:1.0:1788813020.832695:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12 00000100:00100000:1.0:1788813020.832705:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:6144:x1875706301647616:12345-192.168.202.13@tcp:40: 00000100:00100000:1.0:1788813020.832774:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:6144:x1875706301647616:12345-192.168.202.13@tcp:40: Request processed in 70us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813020.832781:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12 00000100:00100000:1.0:1788813020.838787:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813020.838817:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813020.838848:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813020.838983:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301647744 00000100:00100000:2.0:1788813020.838993:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301647744 00000100:00100000:1.0:1788813020.839002:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813020.839024:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301648128 00000100:00100000:1.0:1788813020.839027:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301648128 00000100:00100000:2.0:1788813020.839034:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301647872 00000100:00100000:2.0:1788813020.839039:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301647872 00000100:00100000:2.0:1788813020.839060:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:1.0:1788813020.839062:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 153 00000100:00100000:2.0:1788813020.839072:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1875706301647744:12345-192.168.202.13@tcp:8: 00000100:00100000:1.0:1788813020.839072:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:2399:x1875706301648128:12345-192.168.202.13@tcp:400: 00010000:00080000:2.0:1788813020.839110:0:8405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp t0 exp 0000000000000000 cur 173 last 0 00000100:00100000:1.0:1788813020.839128:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:2399:x1875706301648128:12345-192.168.202.13@tcp:400: Request processed in 59us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813020.839134:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 153 00000020:00000080:2.0:1788813020.839163:0:8405:0:(genops.c:1384:class_connect()) connect: client d2fa4f95-78d4-4e44-8582-bb12ec2edfd4, cookie 0xf32533d6ff702946 00002000:00100000:2.0:1788813020.839176:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d2fa4f95-78d4-4e44-8582-bb12ec2edfd4/ffff948941927000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788813020.839194:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788813020.839417:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788813020.839459:0:8405:0:(import.c:65:import_set_state_nolock()) ffff948941922000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813020.839547:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2395:x1875706301647744:12345-192.168.202.13@tcp:8: Request processed in 476us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813020.839554:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:2.0:1788813020.839572:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:2.0:1788813020.839577:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1875706301647872:12345-192.168.202.13@tcp:8: 00010000:00080000:2.0:1788813020.839592:0:8405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:2.0:1788813020.839607:0:8405:0:(genops.c:1384:class_connect()) connect: client d2fa4f95-78d4-4e44-8582-bb12ec2edfd4, cookie 0xf32533d6ff70294d 00002000:00100000:2.0:1788813020.839612:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d2fa4f95-78d4-4e44-8582-bb12ec2edfd4/ffff948941920000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788813020.839622:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788813020.839863:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788813020.839890:0:8405:0:(import.c:65:import_set_state_nolock()) ffff948941927800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813020.839911:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2395:x1875706301647872:12345-192.168.202.13@tcp:8: Request processed in 334us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813020.839916:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:0.0:1788813020.840381:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301648000 00000100:00100000:0.0:1788813020.840387:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301648000 00000100:00100000:0.0:1788813020.840430:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:0.0:1788813020.840438:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:6144:x1875706301648000:12345-192.168.202.13@tcp:900: 00000100:00100000:0.0:1788813020.840487:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:6144:x1875706301648000:12345-192.168.202.13@tcp:900: Request processed in 38us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813020.840495:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:1.0:1788813020.842537:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813020.842624:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301648256 00000100:00100000:2.0:1788813020.842632:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301648256 00000100:00100000:2.0:1788813020.842708:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:2.0:1788813020.842718:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:6144:x1875706301648256:12345-192.168.202.13@tcp:33: 00000004:00080000:0.0:1788813020.862487:0:6497:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 19691us 00000004:00200000:3.0:1788813020.870070:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788813020.870206:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:6144:x1875706301648256:12345-192.168.202.13@tcp:33: Request processed in 27483us (27671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813020.870220:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:2.0:1788813020.973073:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813020.973167:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301648384 00000100:00100000:0.0:1788813020.973178:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301648384 00000100:00100000:0.0:1788813020.973291:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:0.0:1788813020.973304:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:6187:x1875706301648384:12345-192.168.202.13@tcp:101: 00010000:00010000:0.0:1788813020.973334:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813020.973398:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda400/0xf32533d6ff702954 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07295c4 expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813020.973461:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70295b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813020.973476:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70295b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813020.973502:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70295b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813020.973558:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788813020.973562:0:9156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813020.973577:0:9156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70295b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813020.973604:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda400/0xf32533d6ff702954 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07295c4 expref: 8 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813020.973621:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70295b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07295c4 expref: 7 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813020.973630:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6aed9100) 00010000:00010000:0.0:1788813020.973632:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813020.973636:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdbc00, rc 0) 00000100:00100000:0.0:1788813020.973701:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:6187:x1875706301648384:12345-192.168.202.13@tcp:101: Request processed in 401us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813020.973708:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13 10000000:01000000:0.0:1788813021.028054:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788813021.028063:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a7b74e800 from 39 10000000:01000000:0.0:1788813021.028069:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788813021.028113:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff702962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813021.028122:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff702962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813021.028155:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff702962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813021.028172:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313216896:0@lo:101: 00000100:00100000:0.0:1788813021.028228:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.028301:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72de40 going to sleep for 11 seconds 00010000:00010000:3.0:1788813021.028585:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813021.028708:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313216896 00000100:00100000:2.0:1788813021.028715:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313216896 00000100:00100000:2.0:1788813021.028757:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788813021.028912:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313216896:12345-0@lo:101: 00010000:00010000:2.0:1788813021.028926:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813021.028958:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702969 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702962 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813021.028984:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702962 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813021.028991:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702962 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813021.028998:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08200, rc 0) 00000100:00100000:2.0:1788813021.029049:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313216896:12345-0@lo:101: Request processed in 284us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813021.029056:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788813021.029140:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313216896:0@lo:101: 00010000:00010000:0.0:1788813021.029152:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff702962 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702969 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813021.029160:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff702962 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702969 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813021.029204:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313217024:0@lo:501: 00000100:00100000:0.0:1788813021.029222:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.029298:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.036591:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313217024 00000100:00100000:1.0:1788813021.036611:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313217024 00000100:00100000:1.0:1788813021.036694:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788813021.036706:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313217024:12345-0@lo:501: 00000100:00100000:1.0:1788813021.037754:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313217024:12345-0@lo:501: Request processed in 1046us (8524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.037786:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788813021.038733:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313217024:0@lo:501: 00000100:00100000:0.0:1788813021.038913:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313217152:0@lo:503: 00000100:00100000:0.0:1788813021.038993:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.039036:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813021.039177:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313217152 00000100:00100000:2.0:1788813021.039183:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313217152 00000100:00100000:2.0:1788813021.039269:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788813021.039290:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313217152:12345-0@lo:503: 00000100:00100000:2.0:1788813021.039421:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313217152:12345-0@lo:503: Request processed in 134us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813021.039428:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788813021.039458:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313217152:0@lo:503: 00000100:00100000:0.0:1788813021.042262:0:10060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10060:1875706313217280:0@lo:502: 00000100:00100000:0.0:1788813021.042481:0:10060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.042524:0:10060:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.043232:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313217280 00000100:00100000:1.0:1788813021.043240:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313217280 00000100:00100000:1.0:1788813021.043301:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788813021.043311:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:10060:x1875706313217280:12345-0@lo:502: 00000100:00100000:1.0:1788813021.043578:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:10060:x1875706313217280:12345-0@lo:502: Request processed in 267us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.043586:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788813021.043621:0:10060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10060:1875706313217280:0@lo:502: 00000100:00100000:0.0:1788813021.043684:0:10060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10060:1875706313217408:0@lo:502: 00000100:00100000:0.0:1788813021.043908:0:10060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.043963:0:10060:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.043997:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313217408 00000100:00100000:1.0:1788813021.044002:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313217408 00000100:00100000:1.0:1788813021.044033:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788813021.044041:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:10060:x1875706313217408:12345-0@lo:502: 00000100:00100000:1.0:1788813021.044116:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:10060:x1875706313217408:12345-0@lo:502: Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.044123:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788813021.044166:0:10060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10060:1875706313217408:0@lo:502: 00000040:00080000:0.0:1788813021.044186:0:10060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788813021.044434:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788813021.044456:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788813021.044467:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff702962 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702969 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813021.044561:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff702962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702969 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813021.044571:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788813021.044573:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788813021.044575:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788813021.044599:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151d200/0xf32533d6ff702970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813021.044607:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a4151d200/0xf32533d6ff702970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813021.044616:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a4151d200/0xf32533d6ff702970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813021.044630:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71411c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313217536:0@lo:101: 00000100:00100000:3.0:1788813021.044660:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813021.044680:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.045692:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313217536 00000100:00100000:1.0:1788813021.045699:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313217536 00000100:00100000:1.0:1788813021.045790:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788813021.045801:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313217536:12345-0@lo:101: 00010000:00010000:1.0:1788813021.045815:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813021.045831:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702977 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702970 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.045856:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702970 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.045867:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702970 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.045886:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8a00, rc 0) 00000100:00100000:1.0:1788813021.045956:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313217536:12345-0@lo:101: Request processed in 158us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.045962:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788813021.046075:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71411c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313217536:0@lo:101: 00010000:00010000:3.0:1788813021.046089:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a4151d200/0xf32533d6ff702970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702977 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813021.046099:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a4151d200/0xf32533d6ff702970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702977 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813021.046176:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71411c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313217664:0@lo:501: 00000100:00100000:3.0:1788813021.046201:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.052370:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313217664 00000100:00100000:3.0:1788813021.052413:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788813021.052460:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313217664 00000100:00100000:0.0:1788813021.052513:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788813021.052523:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313217664:12345-0@lo:501: 00000100:00100000:0.0:1788813021.052788:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313217664:12345-0@lo:501: Request processed in 266us (6584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813021.052797:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788813021.052871:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71411c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313217664:0@lo:501: 00000100:00100000:3.0:1788813021.052921:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71411c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313217792:0@lo:503: 00000100:00100000:3.0:1788813021.053081:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813021.053239:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813021.053293:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313217792 00000100:00100000:2.0:1788813021.053299:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313217792 00000100:00100000:1.0:1788813021.053340:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788813021.053351:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313217792:12345-0@lo:503: 00000100:00100000:1.0:1788813021.053457:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313217792:12345-0@lo:503: Request processed in 109us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.053464:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788813021.053612:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71411c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313217792:0@lo:503: 00000100:00100000:1.0:1788813021.054003:0:10061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76415f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10061:1875706313217920:0@lo:502: 00000100:00100000:1.0:1788813021.054037:0:10061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.054055:0:10061:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6eb2d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813021.054122:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313217920 00000100:00100000:0.0:1788813021.054127:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313217920 00000100:00100000:0.0:1788813021.054165:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788813021.054171:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:10061:x1875706313217920:12345-0@lo:502: 00000100:00100000:0.0:1788813021.054264:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:10061:x1875706313217920:12345-0@lo:502: Request processed in 92us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813021.054271:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788813021.054621:0:10061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76415f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10061:1875706313217920:0@lo:502: 00000020:01000000:3.0:1788813021.054647:0:10061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813021.054657:0:10061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813021.054659:0:10061:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788813021.054664:0:10061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788813021.054666:0:10061:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788813021.054684:0:10061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71411c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10061:1875706313218048:0@lo:502: 00000100:00100000:3.0:1788813021.054718:0:10061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813021.054750:0:10061:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788813021.054797:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313218048 00000100:00100000:0.0:1788813021.054801:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313218048 00000100:00100000:0.0:1788813021.054823:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788813021.054829:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:10061:x1875706313218048:12345-0@lo:502: 00000100:00100000:0.0:1788813021.054904:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:10061:x1875706313218048:12345-0@lo:502: Request processed in 74us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813021.054910:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788813021.055007:0:10061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71411c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10061:1875706313218048:0@lo:502: 00000020:01000000:3.0:1788813021.055025:0:10061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813021.055029:0:10061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813021.055030:0:10061:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788813021.055034:0:10061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788813021.055251:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788813021.055287:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788813021.055296:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151d200/0xf32533d6ff702970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702977 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813021.055306:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4151d200/0xf32533d6ff702970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702977 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813021.055314:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788813021.055316:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a61047800 from 39 10000000:01000000:0.0:1788813021.055319:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788813021.055342:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda000/0xf32533d6ff70297e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813021.055350:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cda000/0xf32533d6ff70297e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813021.055358:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cda000/0xf32533d6ff70297e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813021.055370:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313218176:0@lo:101: 00000100:00100000:0.0:1788813021.055410:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.055439:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.055551:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313218176 00000100:00100000:1.0:1788813021.055556:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313218176 00000100:00100000:1.0:1788813021.055577:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788813021.055585:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313218176:12345-0@lo:101: 00010000:00010000:1.0:1788813021.055594:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813021.055606:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f9800/0xf32533d6ff702985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70297e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.055624:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f9800/0xf32533d6ff702985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70297e expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.055635:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f9800/0xf32533d6ff702985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70297e expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.055713:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9800, rc 0) 00000100:00100000:1.0:1788813021.055752:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313218176:12345-0@lo:101: Request processed in 168us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.055758:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788813021.055853:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313218176:0@lo:101: 00010000:00010000:0.0:1788813021.055865:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cda000/0xf32533d6ff70297e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702985 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813021.055873:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cda000/0xf32533d6ff70297e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702985 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813021.055973:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313218304:0@lo:501: 00000100:00100000:0.0:1788813021.055998:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.056014:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.056105:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313218304 00000100:00100000:1.0:1788813021.056110:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313218304 00000100:00100000:3.0:1788813021.056191:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788813021.056199:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313218304:12345-0@lo:501: 00000100:00100000:3.0:1788813021.056387:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313218304:12345-0@lo:501: Request processed in 190us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813021.056401:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788813021.056531:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313218304:0@lo:501: 00000100:00100000:0.0:1788813021.056556:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313218432:0@lo:503: 00000100:00100000:0.0:1788813021.056589:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.056607:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813021.056644:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313218432 00000100:00100000:3.0:1788813021.056648:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313218432 00000100:00100000:3.0:1788813021.056716:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788813021.056723:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313218432:12345-0@lo:503: 00000100:00100000:3.0:1788813021.056799:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313218432:12345-0@lo:503: Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813021.056805:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788813021.056993:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313218432:0@lo:503: 00000100:00100000:3.0:1788813021.057546:0:10062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71411c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10062:1875706313218560:0@lo:502: 00000100:00100000:3.0:1788813021.057584:0:10062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813021.057613:0:10062:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813021.057661:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313218560 00000100:00100000:2.0:1788813021.057665:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313218560 00000100:00100000:2.0:1788813021.057701:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788813021.057708:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:10062:x1875706313218560:12345-0@lo:502: 00000100:00100000:2.0:1788813021.057799:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:10062:x1875706313218560:12345-0@lo:502: Request processed in 91us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813021.057805:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788813021.057872:0:10062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71411c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10062:1875706313218560:0@lo:502: 00000100:00100000:3.0:1788813021.057908:0:10062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71411c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10062:1875706313218688:0@lo:502: 00000100:00100000:3.0:1788813021.057960:0:10062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813021.057980:0:10062:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813021.058033:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313218688 00000100:00100000:0.0:1788813021.058037:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313218688 00000100:00100000:0.0:1788813021.058057:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788813021.058063:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:10062:x1875706313218688:12345-0@lo:502: 00000100:00100000:0.0:1788813021.058249:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:10062:x1875706313218688:12345-0@lo:502: Request processed in 185us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813021.058256:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788813021.058330:0:10062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71411c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10062:1875706313218688:0@lo:502: 00000040:00080000:3.0:1788813021.058350:0:10062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788813021.058606:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788813021.058625:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788813021.058632:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda000/0xf32533d6ff70297e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702985 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813021.058641:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cda000/0xf32533d6ff70297e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702985 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813021.058650:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788813021.058653:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a61047800 from 6 10000000:01000000:0.0:1788813021.058661:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788813021.058683:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813021.058690:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813021.058699:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813021.058711:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313218816:0@lo:101: 00000100:00100000:0.0:1788813021.058737:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.058766:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813021.058805:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313218816 00000100:00100000:3.0:1788813021.058809:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313218816 00000100:00100000:3.0:1788813021.058840:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788813021.058847:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313218816:12345-0@lo:101: 00010000:00010000:3.0:1788813021.058856:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813021.058867:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a4151d400/0xf32533d6ff702993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70298c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813021.058885:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a4151d400/0xf32533d6ff702993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70298c expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813021.058894:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a4151d400/0xf32533d6ff702993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70298c expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813021.058912:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4151d400, rc 0) 00000100:00100000:3.0:1788813021.058972:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313218816:12345-0@lo:101: Request processed in 126us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813021.058979:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788813021.059095:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313218816:0@lo:101: 00010000:00010000:0.0:1788813021.059107:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702993 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813021.059115:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702993 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813021.059268:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313218944:0@lo:256: 00000100:00100000:0.0:1788813021.059308:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.059335:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813021.059372:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313218944 00000100:00100000:3.0:1788813021.059376:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313218944 00000100:00100000:3.0:1788813021.059475:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788813021.059482:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313218944:12345-0@lo:256: 20000000:01000000:3.0:1788813021.059496:0:6487:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788813021.059513:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788813021.059516:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788813021.059726:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313218944:12345-0@lo:256: Request processed in 244us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813021.059732:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788813021.059832:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313218944:0@lo:256: 10000000:01000000:0.0:1788813021.059874:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788813021.059880:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702993 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813021.059887:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702993 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813021.059900:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788813021.059902:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788813021.059904:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788813021.059919:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff70299a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813021.059926:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff70299a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813021.060045:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff70299a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813021.060058:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313219072:0@lo:101: 00000100:00100000:0.0:1788813021.060083:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.060158:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788813021.060246:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313219072 00000100:00100000:2.0:1788813021.060257:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313219072 00000100:00100000:2.0:1788813021.060334:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788813021.060343:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313219072:12345-0@lo:101: 00010000:00010000:2.0:1788813021.060351:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813021.060362:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc09e00/0xf32533d6ff7029a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff70299a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813021.060379:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc09e00/0xf32533d6ff7029a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff70299a expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813021.060463:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc09e00/0xf32533d6ff7029a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70299a expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813021.060474:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09e00, rc 0) 00000100:00100000:2.0:1788813021.060515:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313219072:12345-0@lo:101: Request processed in 174us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813021.060521:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788813021.060579:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313219072:0@lo:101: 00010000:00010000:0.0:1788813021.060592:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff70299a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7029a1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813021.060600:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff70299a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7029a1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813021.060650:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313219200:0@lo:501: 00000100:00100000:0.0:1788813021.060675:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.060756:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813021.060839:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313219200 00000100:00100000:3.0:1788813021.060843:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313219200 00000100:00100000:3.0:1788813021.060862:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788813021.060867:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313219200:12345-0@lo:501: 00000100:00100000:3.0:1788813021.061005:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313219200:12345-0@lo:501: Request processed in 137us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813021.061012:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788813021.061104:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313219200:0@lo:501: 00000100:00100000:0.0:1788813021.061129:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313219328:0@lo:503: 00000100:00100000:0.0:1788813021.061187:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.061213:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813021.061292:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313219328 00000100:00100000:3.0:1788813021.061297:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313219328 00000100:00100000:3.0:1788813021.061315:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788813021.061321:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313219328:12345-0@lo:503: 00000100:00100000:3.0:1788813021.061409:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313219328:12345-0@lo:503: Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813021.061421:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788813021.061537:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313219328:0@lo:503: 00000100:00100000:0.0:1788813021.061844:0:10063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10063:1875706313219456:0@lo:502: 00000100:00100000:0.0:1788813021.061881:0:10063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.061905:0:10063:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813021.061978:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313219456 00000100:00100000:3.0:1788813021.061982:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313219456 00000100:00100000:3.0:1788813021.062002:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788813021.062008:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:10063:x1875706313219456:12345-0@lo:502: 00000100:00100000:3.0:1788813021.062079:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:10063:x1875706313219456:12345-0@lo:502: Request processed in 70us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813021.062085:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788813021.062208:0:10063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10063:1875706313219456:0@lo:502: 00000020:01000000:0.0:1788813021.062230:0:10063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788813021.062237:0:10063:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788813021.062243:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813021.062245:0:10063:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788813021.062250:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788813021.062254:0:10063:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:01000000:0.0:1788813021.062334:0:10063:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788813021.062337:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788813021.062353:0:10063:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff94894207b380) 00000020:00000080:0.0:1788813021.062380:0:10063:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1788813021.062387:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788813021.062484:0:10063:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788813021.062491:0:10063:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788813021.062498:0:10063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff7029af 00010000:00080000:0.0:1788813021.062525:0:10063:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a7ccee800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.113@tcp at head 00010000:00010000:0.0:1788813021.062738:0:10063:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1788813021.062851:0:10063:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788813021.062862:0:10063:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788813021.063066:0:10063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813021.063192:0:10063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813021.063360:0:10063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788813021.063452:0:10063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788813021.064086:0:10064:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813021.064091:0:10064:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788813021.064861:0:10063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788813021.064871:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788813021.064905:0:10063:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788813021.064927:0:10063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff7029b6 00000100:00080000:2.0:1788813021.065085:0:10063:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788813021.065098:0:10063:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff948a7ccee800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813021.065196:0:10063:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a76405f80 x1875706313219584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813021.065244:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313219584:0@lo:8: 00000100:00100000:0.0:1788813021.065318:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813021.065399:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313219584 00000100:00100000:3.0:1788813021.065406:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313219584 00000100:00100000:3.0:1788813021.065445:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788813021.065453:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1875706313219584:12345-0@lo:8: 00010000:00080000:3.0:1788813021.065477:0:8403:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:3.0:1788813021.065502:0:8403:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff7029bd 00002000:00100000:3.0:1788813021.065514:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff948a7b791800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788813021.065518:0:8403:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788813021.065522:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788813021.065574:0:8403:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788813021.065680:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788813021.065702:0:8403:0:(import.c:65:import_set_state_nolock()) ffff948a7b797000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788813021.066082:0:10063:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788813021.066170:0:10063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813021.066176:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813021.066178:0:10063:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788813021.066192:0:10063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813021.066197:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813021.066198:0:10063:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788813021.066201:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788813021.066202:0:10063:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788813021.066229:0:10063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10063:1875706313219712:0@lo:502: 00000100:00100000:2.0:1788813021.066285:0:10063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813021.066308:0:10063:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813021.066341:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313219712 00000100:00100000:2.0:1788813021.066346:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313219712 00000100:00100000:2.0:1788813021.066378:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788813021.066386:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:10063:x1875706313219712:12345-0@lo:502: 00000100:00100000:1.0:1788813021.066561:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313219840:0@lo:400: 00000100:00100000:1.0:1788813021.066592:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.066612:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313220352:0@lo:400: 00000100:00100000:1.0:1788813021.066632:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.066649:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313220864:0@lo:400: 00000100:00100000:1.0:1788813021.066673:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.066693:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788813021.066698:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313219968:0@lo:400: 00000100:00100000:1.0:1788813021.066719:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.066736:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313220480:0@lo:400: 00000100:00100000:1.0:1788813021.066754:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.066769:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313220992:0@lo:400: 00000100:00100000:1.0:1788813021.066791:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.066813:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313220096:0@lo:400: 00000100:00100000:1.0:1788813021.066835:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.066845:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313220608:0@lo:400: 00000100:00100000:1.0:1788813021.066874:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.066895:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788813021.066907:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313220224:0@lo:400: 00000100:00100000:1.0:1788813021.066928:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.066975:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313220736:0@lo:400: 00000100:00100000:1.0:1788813021.066994:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.067020:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313219840 00000100:00100000:1.0:1788813021.067024:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313219840 00000100:00100000:1.0:1788813021.067046:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313220352 00000100:00100000:1.0:1788813021.067049:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313220352 00000100:00100000:1.0:1788813021.067070:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313220864 00000100:00100000:1.0:1788813021.067072:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313220864 00000100:00100000:1.0:1788813021.067085:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313220480 00000100:00100000:1.0:1788813021.067087:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313220480 00000100:00100000:1.0:1788813021.067097:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313220992 00000100:00100000:1.0:1788813021.067099:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313220992 00000100:00100000:1.0:1788813021.067109:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313220096 00000100:00100000:1.0:1788813021.067112:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313220096 00000100:00100000:1.0:1788813021.067123:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788813021.067129:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313219840:12345-0@lo:400: 00000100:00100000:1.0:1788813021.067171:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313219840:12345-0@lo:400: Request processed in 42us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.067178:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788813021.067192:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813021.067198:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313220352:12345-0@lo:400: 00000100:00100000:1.0:1788813021.067221:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313220352:12345-0@lo:400: Request processed in 24us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.067227:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813021.067236:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813021.067242:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313220864:12345-0@lo:400: 00000100:00100000:1.0:1788813021.067265:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313220864:12345-0@lo:400: Request processed in 24us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.067291:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813021.067302:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788813021.067308:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313220480:12345-0@lo:400: 00000100:00100000:1.0:1788813021.067335:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313220480:12345-0@lo:400: Request processed in 27us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.067340:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788813021.067350:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788813021.067355:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313220992:12345-0@lo:400: 00000100:00100000:1.0:1788813021.067379:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313220992:12345-0@lo:400: Request processed in 24us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.067385:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788813021.067405:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788813021.067412:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313220096:12345-0@lo:400: 00000100:00100000:1.0:1788813021.067442:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313220096:12345-0@lo:400: Request processed in 31us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.067447:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788813021.067470:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313219968 00000100:00100000:1.0:1788813021.067473:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313219968 00000100:00100000:1.0:1788813021.067494:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313220224 00000100:00100000:1.0:1788813021.067497:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313220224 00000100:00100000:1.0:1788813021.067510:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788813021.067516:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313219968:12345-0@lo:400: 00000100:00100000:1.0:1788813021.067547:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313219968:12345-0@lo:400: Request processed in 31us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.067552:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788813021.067563:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788813021.067576:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313220224:12345-0@lo:400: 00000100:00100000:1.0:1788813021.067605:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313220224:12345-0@lo:400: Request processed in 30us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.067610:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788813021.067632:0:8405:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788813021.067639:0:8405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1788813021.067671:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788813021.067675:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813021.067685:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788813021.067691:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313220608 00000100:00100000:1.0:1788813021.067693:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313220608 00000100:00100000:1.0:1788813021.067714:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788813021.067719:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313220736 00000100:00100000:1.0:1788813021.067721:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313220736 00000100:00100000:1.0:1788813021.067733:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788813021.067738:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813021.067744:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313220608:12345-0@lo:400: 00000100:00100000:1.0:1788813021.067773:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313220608:12345-0@lo:400: Request processed in 28us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.067778:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813021.067787:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788813021.067793:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813021.067798:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313220736:12345-0@lo:400: 00000100:00100000:1.0:1788813021.067835:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313220736:12345-0@lo:400: Request processed in 36us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.067840:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788813021.067854:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813021.067877:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313220224:0@lo:400: 00010000:00080000:1.0:1788813021.067889:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76414000 x1875706313220736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813021.067905:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313220736:0@lo:400: 00000100:00100000:1.0:1788813021.067918:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313220096:0@lo:400: 00010000:00080000:1.0:1788813021.067926:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76415180 x1875706313220608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813021.067958:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313220608:0@lo:400: 00000100:00100000:1.0:1788813021.067991:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313219968:0@lo:400: 00010000:00080000:1.0:1788813021.068001:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76414380 x1875706313220480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813021.068009:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313220480:0@lo:400: 00010000:00080000:1.0:1788813021.068018:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76417100 x1875706313220992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813021.068025:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313220992:0@lo:400: 00000100:00100000:1.0:1788813021.068035:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313219840:0@lo:400: 00000100:00100000:1.0:1788813021.068044:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313220352:0@lo:400: 00000100:00100000:1.0:1788813021.068052:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313220864:0@lo:400: 00000100:00100000:2.0:1788813021.068971:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:10063:x1875706313219712:12345-0@lo:502: Request processed in 2583us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813021.068980:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788813021.072637:0:10063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10063:1875706313219712:0@lo:502: 00000020:01000000:1.0:1788813021.072691:0:10063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813021.072703:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813021.072705:0:10063:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788813021.072709:0:10063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1788813021.072971:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1788813021.072994:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788813021.073004:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff70299a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7029a1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813021.073017:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff70299a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7029a1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813021.073027:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788813021.073029:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a60186000 from 39 10000000:01000000:2.0:1788813021.073032:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788813021.073066:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7029c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813021.073075:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7029c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813021.073096:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7029c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813021.073115:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313221120:0@lo:101: 00000100:00100000:2.0:1788813021.073184:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813021.073218:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256840 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.073484:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313221120 00000100:00100000:1.0:1788813021.073496:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313221120 00000100:00100000:1.0:1788813021.073547:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788813021.073557:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313221120:12345-0@lo:101: 00010000:00010000:1.0:1788813021.073568:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813021.073580:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff7029cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7029c4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.073666:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff7029cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7029c4 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.073676:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff7029cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7029c4 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.073684:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8000, rc 0) 00000100:00100000:1.0:1788813021.073720:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313221120:12345-0@lo:101: Request processed in 165us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.073727:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788813021.073821:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313221120:0@lo:101: 00010000:00010000:2.0:1788813021.073835:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7029c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7029cb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813021.073845:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7029c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7029cb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813021.073896:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313221248:0@lo:501: 00000100:00100000:2.0:1788813021.073927:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813021.073974:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256840 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.074025:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313221248 00000100:00100000:1.0:1788813021.074029:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313221248 00000100:00100000:1.0:1788813021.074062:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788813021.074069:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313221248:12345-0@lo:501: 00000100:00100000:1.0:1788813021.074168:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313221248:12345-0@lo:501: Request processed in 100us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.074175:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788813021.074215:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313221248:0@lo:501: 00000100:00100000:2.0:1788813021.074242:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313221376:0@lo:503: 00000100:00100000:2.0:1788813021.074292:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813021.074313:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256840 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.075135:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313221376 00000100:00100000:1.0:1788813021.075141:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313221376 00000100:00100000:1.0:1788813021.075172:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788813021.075177:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313221376:12345-0@lo:503: 00000100:00100000:1.0:1788813021.075259:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313221376:12345-0@lo:503: Request processed in 82us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.075268:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788813021.075306:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313221376:0@lo:503: 00010000:00080000:0.0:1788813021.075357:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76405f80 x1875706313219584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813021.075368:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788813021.075376:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788813021.075383:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788813021.075388:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788813021.075391:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7ccee800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788813021.075424:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788813021.075429:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313219584:0@lo:8: 00000004:00080000:0.0:1788813021.075452:0:10064:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788813021.075494:0:10065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875706313221504:0@lo:700: 00000004:00080000:0.0:1788813021.075518:0:10064:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 174094584550ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788813021.075525:0:10064:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788813021.075551:0:10065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.075556:0:10067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10067:1875706313221632:0@lo:502: 00000100:00100000:2.0:1788813021.075591:0:10065:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256840 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.075664:0:10067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.075727:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313221504 00000100:00100000:1.0:1788813021.075730:0:10067:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6eb2d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813021.075732:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313221504 00000100:00100000:0.0:1788813021.075789:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813021.075797:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+7:10065:x1875706313221504:12345-0@lo:700: 00000100:00100000:0.0:1788813021.075825:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8414:1875706313221760:0@lo:700: 00000100:00100000:0.0:1788813021.075851:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.075869:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813021.075978:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3624:x1875706313219584:12345-0@lo:8: Request processed in 10522us (10658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813021.075986:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788813021.076085:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813021.076260:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313221760 00000100:00100000:3.0:1788813021.076264:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313221760 00000100:00100000:3.0:1788813021.076306:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813021.076314:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8414:x1875706313221760:12345-0@lo:700: 00000100:00100000:2.0:1788813021.077314:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313221632 00000100:00100000:2.0:1788813021.077330:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313221632 00000100:00100000:0.0:1788813021.077459:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788813021.077467:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:10067:x1875706313221632:12345-0@lo:502: 00000100:00100000:0.0:1788813021.077603:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:10067:x1875706313221632:12345-0@lo:502: Request processed in 136us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813021.077616:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788813021.079038:0:10067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10067:1875706313221632:0@lo:502: 00000100:00100000:0.0:1788813021.079117:0:10067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10067:1875706313221888:0@lo:502: 00000100:00100000:0.0:1788813021.079177:0:10067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.079211:0:10067:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813021.079419:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313221888 00000100:00100000:2.0:1788813021.079426:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313221888 00000100:00100000:2.0:1788813021.079463:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788813021.079470:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:10067:x1875706313221888:12345-0@lo:502: 00000100:00100000:2.0:1788813021.079565:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:10067:x1875706313221888:12345-0@lo:502: Request processed in 95us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813021.079572:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788813021.080287:0:10067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10067:1875706313221888:0@lo:502: 00000040:00080000:0.0:1788813021.080382:0:10067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788813021.080468:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788813021.080493:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788813021.080503:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7029c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7029cb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.080513:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7029c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7029cb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813021.080523:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788813021.080525:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a60186000 from 6 10000000:01000000:1.0:1788813021.080528:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788813021.080554:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.080562:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.080571:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813021.080584:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313222016:0@lo:101: 00000100:00100000:1.0:1788813021.080678:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.080736:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6eb2d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813021.080766:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313222016 00000100:00100000:2.0:1788813021.080770:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313222016 00000100:00100000:2.0:1788813021.080799:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788813021.080805:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313222016:12345-0@lo:101: 00010000:00010000:2.0:1788813021.080814:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813021.080824:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc09800/0xf32533d6ff7029d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7029d2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813021.080842:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc09800/0xf32533d6ff7029d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7029d2 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813021.081072:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc09800/0xf32533d6ff7029d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7029d2 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813021.081081:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09800, rc 0) 00000100:00100000:2.0:1788813021.081153:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313222016:12345-0@lo:101: Request processed in 347us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813021.081159:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788813021.081211:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313222016:0@lo:101: 00010000:00010000:1.0:1788813021.081233:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7029d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.081241:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7029d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813021.081353:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313222144:0@lo:256: 00000100:00100000:1.0:1788813021.081381:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.081450:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6eb2d540 going to sleep for 11 seconds 00000004:00080000:0.0:1788813021.082997:0:7425:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000001:00100000:0.0:1788813021.084259:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000100:00100000:2.0:1788813021.085227:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313222144 00000100:00100000:2.0:1788813021.085239:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313222144 00000100:00100000:2.0:1788813021.085310:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788813021.085320:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313222144:12345-0@lo:256: 20000000:01000000:2.0:1788813021.085356:0:6487:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788813021.085374:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788813021.085377:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788813021.085507:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313222144:12345-0@lo:256: Request processed in 189us (4124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813021.085515:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000001:00100000:1.0:1788813021.086325:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 40000000:02000000:2.0:1788813021.086452:0:6501:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1788813021.088027:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313222144:0@lo:256: 10000000:01000000:1.0:1788813021.088095:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788813021.088104:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7029d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.088114:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7029d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813021.088123:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788813021.088125:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788813021.088128:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788813021.088157:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8c00/0xf32533d6ff7029e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.088165:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8c00/0xf32533d6ff7029e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.088174:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8c00/0xf32533d6ff7029e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813021.088202:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313222272:0@lo:101: 00000100:00100000:1.0:1788813021.088246:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.088291:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6eb2d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.088310:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313222272 00000100:00100000:1.0:1788813021.088315:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313222272 00000100:00100000:1.0:1788813021.088349:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788813021.088356:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313222272:12345-0@lo:101: 00010000:00010000:1.0:1788813021.088367:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813021.088377:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff7029e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7029e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.088395:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff7029e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7029e0 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.088415:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff7029e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7029e0 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.088423:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9400, rc 0) 00000100:00100000:1.0:1788813021.088454:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313222272:12345-0@lo:101: Request processed in 98us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.088460:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788813021.088489:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313222272:0@lo:101: 00010000:00010000:1.0:1788813021.088499:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8c00/0xf32533d6ff7029e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7029e7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.088508:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8c00/0xf32533d6ff7029e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7029e7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813021.088560:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313222400:0@lo:501: 00000100:00100000:1.0:1788813021.088580:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.088610:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313222400 00000100:00100000:1.0:1788813021.088613:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313222400 00000100:00100000:1.0:1788813021.088631:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788813021.088636:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313222400:12345-0@lo:501: 00000100:00100000:1.0:1788813021.088719:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313222400:12345-0@lo:501: Request processed in 83us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.088725:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788813021.088744:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6eb2d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.088752:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313222400:0@lo:501: 00000100:00100000:1.0:1788813021.088771:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313222528:0@lo:503: 00000100:00100000:1.0:1788813021.088802:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.088817:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313222528 00000100:00100000:1.0:1788813021.088819:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313222528 00000100:00100000:1.0:1788813021.088835:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788813021.088840:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313222528:12345-0@lo:503: 00000100:00100000:1.0:1788813021.088898:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313222528:12345-0@lo:503: Request processed in 57us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.088904:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788813021.088928:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6eb2d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.088957:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313222528:0@lo:503: 00000100:00100000:1.0:1788813021.089117:0:10068:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10068:1875706313222656:0@lo:502: 00000100:00100000:1.0:1788813021.089147:0:10068:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.089176:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313222656 00000100:00100000:1.0:1788813021.089180:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313222656 00000100:00100000:1.0:1788813021.089202:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788813021.089208:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:10068:x1875706313222656:12345-0@lo:502: 00000100:00100000:1.0:1788813021.089289:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:10068:x1875706313222656:12345-0@lo:502: Request processed in 81us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.089294:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788813021.089328:0:10068:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6eb2d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.089340:0:10068:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10068:1875706313222656:0@lo:502: 00000020:01000000:1.0:1788813021.089359:0:10068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813021.089365:0:10068:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788813021.089371:0:10068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813021.089373:0:10068:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788813021.089377:0:10068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788813021.089380:0:10068:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:01000000:1.0:1788813021.089400:0:10068:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788813021.089402:0:10068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813021.089430:0:10068:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff948a7b704d40) 00000020:00000080:1.0:1788813021.089453:0:10068:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1788813021.089458:0:10068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788813021.089522:0:10068:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788813021.089527:0:10068:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788813021.089534:0:10068:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff7029f5 00010000:00080000:1.0:1788813021.089559:0:10068:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a7cce2800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813021.089721:0:10068:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1788813021.089806:0:10068:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788813021.089813:0:10068:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788813021.089925:0:10068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813021.090092:0:10068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813021.090227:0:10068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788813021.090334:0:10068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788813021.091306:0:10069:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813021.091311:0:10069:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788813021.093546:0:10068:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788813021.093559:0:10068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788813021.093600:0:10068:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788813021.093626:0:10068:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff7029fc 00000100:00080000:0.0:1788813021.093636:0:10068:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788813021.093648:0:10068:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948a7cce2800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813021.093683:0:10068:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a764c8380 x1875706313222784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813021.093712:0:10068:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788813021.093760:0:10068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813021.093764:0:10068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813021.093767:0:10068:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788813021.093776:0:10068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813021.093780:0:10068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813021.093781:0:10068:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788813021.093785:0:10068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788813021.093787:0:10068:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788813021.093812:0:10068:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10068:1875706313222912:0@lo:502: 00000100:00100000:0.0:1788813021.093885:0:10068:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.093926:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313222912 00000100:00100000:0.0:1788813021.093958:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313222912 00000100:00100000:0.0:1788813021.093996:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788813021.094004:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:10068:x1875706313222912:12345-0@lo:502: 00000100:00100000:0.0:1788813021.094109:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:10068:x1875706313222912:12345-0@lo:502: Request processed in 106us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813021.094117:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788813021.094162:0:10068:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813021.094183:0:10068:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10068:1875706313222912:0@lo:502: 00000020:01000000:0.0:1788813021.094207:0:10068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813021.094211:0:10068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813021.094212:0:10068:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788813021.094216:0:10068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:1.0:1788813021.094387:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313222784:0@lo:8: 00000100:00100000:1.0:1788813021.094428:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788813021.094474:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1788813021.094493:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788813021.094502:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8c00/0xf32533d6ff7029e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7029e7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.094512:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8c00/0xf32533d6ff7029e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7029e7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813021.094521:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788813021.094523:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff948a506e4d40 from 1 10000000:01000000:1.0:1788813021.094526:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788813021.094550:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.094558:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.094567:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813021.094579:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313223040:0@lo:101: 00000100:00100000:1.0:1788813021.094604:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.094618:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a749f7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.094640:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313223040 00000100:00100000:1.0:1788813021.094644:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313223040 00000100:00100000:1.0:1788813021.094669:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788813021.094675:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313223040:12345-0@lo:101: 00010000:00010000:1.0:1788813021.094683:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813021.094701:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702a03 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.094719:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702a03 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.094729:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702a03 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.094736:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9a00, rc 0) 00000100:00100000:1.0:1788813021.094763:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313223040:12345-0@lo:101: Request processed in 88us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.094769:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788813021.094801:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313223040:0@lo:101: 00010000:00010000:1.0:1788813021.094813:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a0a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.094821:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702a0a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813021.094862:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313223168:0@lo:501: 00000100:00100000:1.0:1788813021.094885:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.094898:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a749f7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788813021.094909:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313223168 00000100:00100000:1.0:1788813021.094912:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313223168 00000100:00100000:1.0:1788813021.094955:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788813021.094962:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313223168:12345-0@lo:501: 00000100:00100000:1.0:1788813021.095024:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313223168:12345-0@lo:501: Request processed in 63us (138us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813021.095040:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788813021.095069:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313223168:0@lo:501: 10000000:01000000:1.0:1788813021.095087:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788813021.095092:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a0a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813021.095099:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a0a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813021.095258:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313222784 00000100:00100000:0.0:1788813021.095263:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313222784 00000100:00100000:0.0:1788813021.095292:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788813021.095298:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3624:x1875706313222784:12345-0@lo:8: 00010000:00080000:0.0:1788813021.095319:0:8404:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:0.0:1788813021.095343:0:8404:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff702a11 00002000:00100000:0.0:1788813021.095355:0:8404:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff948a7cce9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788813021.095359:0:8404:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788813021.095367:0:8404:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788813021.095429:0:8404:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788813021.095450:0:8404:0:(import.c:65:import_set_state_nolock()) ffff948a7ccef000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813021.095489:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1875706313222784:12345-0@lo:8: Request processed in 191us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813021.095496:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788813021.095526:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a764c8380 x1875706313222784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813021.095536:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788813021.095542:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788813021.095549:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788813021.095554:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788813021.095556:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7cce2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788813021.095566:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788813021.095571:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313222784:0@lo:8: 00000004:00080000:0.0:1788813021.095590:0:10069:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788813021.095631:0:10069:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 174114698121ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788813021.095637:0:10069:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788813021.096172:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8414:x1875706313221760:12345-0@lo:700: Request processed in 19858us (20318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813021.096182:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813021.099525:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8414:1875706313221760:0@lo:700: 40000000:02000000:3.0:1788813021.099543:0:8414:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000004:00080000:0.0:1788813021.103262:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788813021.105629:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313223296:0@lo:13: 00000100:00100000:2.0:1788813021.105693:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813021.105737:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313223296 00000100:00100000:3.0:1788813021.105746:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313223296 00000004:00080000:1.0:1788813021.105751:0:10070:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788813021.105773:0:10070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10070:1875706313223424:0@lo:7: 00000100:00100000:1.0:1788813021.105800:0:10070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813021.105801:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813021.105809:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313223296:12345-0@lo:13: 00000100:00100000:1.0:1788813021.105815:0:10070:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a749f7300 going to sleep for 11 seconds 00002000:00000024:3.0:1788813021.105828:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 3923951616 avail 3692429312 00000100:00100000:3.0:1788813021.105881:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313223296:12345-0@lo:13: Request processed in 73us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813021.105882:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313223424 00000100:00100000:2.0:1788813021.105886:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313223424 00000100:00100000:3.0:1788813021.105888:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788813021.105908:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813021.105912:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813021.105919:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10070:x1875706313223424:12345-0@lo:7: 00010000:00080000:1.0:1788813021.106746:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccbce00 x1875706313223296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813021.106765:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313223296:0@lo:13: 00000001:00100000:1.0:1788813021.108436:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788813021.108444:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788813021.108450:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00010000:00080000:1.0:1788813021.108970:0:10065:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76407800 x1875706313221504/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788813037 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813021.108985:0:10065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875706313221504:0@lo:700: 00000100:00100000:3.0:1788813021.109101:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10065:x1875706313221504:12345-0@lo:700: Request processed in 32793us (33040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813021.109111:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00080000:2.0:1788813021.112235:0:8403:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788813021.112242:0:8403:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788813021.112354:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10070:x1875706313223424:12345-0@lo:7: Request processed in 6431us (6549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813021.112363:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788813021.112625:0:10070:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccbca80 x1875706313223424/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788813037 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813021.112653:0:10070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10070:1875706313223424:0@lo:7: 00000004:00080000:1.0:1788813021.112667:0:10070:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788813021.112702:0:10070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10070:1875706313223552:0@lo:5: 00000100:00100000:1.0:1788813021.112736:0:10070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.112783:0:10070:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a749f7300 going to sleep for 11 seconds 00000100:00100000:0.0:1788813021.113228:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313223552 00000100:00100000:0.0:1788813021.113244:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313223552 00000100:00100000:0.0:1788813021.113295:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813021.113305:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10070:x1875706313223552:12345-0@lo:5: 00002000:00080000:0.0:1788813021.113329:0:8404:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788813021.113333:0:8404:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788813021.113580:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10070:x1875706313223552:12345-0@lo:5: Request processed in 276us (843us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788813021.113586:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788813021.113609:0:10070:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccbca80 x1875706313223552/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813037 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813021.113621:0:10070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10070:1875706313223552:0@lo:5: 00000004:00080000:1.0:1788813021.113631:0:10070:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788813021.113656:0:10070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10070:1875706313223680:0@lo:700: 00000100:00100000:1.0:1788813021.113677:0:10070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.113694:0:10070:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a749f7300 going to sleep for 11 seconds 00000100:00100000:0.0:1788813021.113708:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313223680 00000100:00100000:0.0:1788813021.113713:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313223680 00000100:00100000:0.0:1788813021.113766:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813021.113771:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10070:x1875706313223680:12345-0@lo:700: 00000100:00100000:0.0:1788813021.114875:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313223808:0@lo:13: 00000100:00100000:0.0:1788813021.114915:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813021.115023:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313223808 00000100:00100000:3.0:1788813021.115028:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313223808 00000100:00100000:3.0:1788813021.115070:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813021.115079:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313223808:12345-0@lo:13: 00002000:00000024:3.0:1788813021.115095:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 3923951616 avail 3692429312 00000004:00080000:1.0:1788813021.115178:0:10065:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788813021.115198:0:10065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875706313223936:0@lo:7: 00000100:00100000:1.0:1788813021.115223:0:10065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.115241:0:10065:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a749f7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813021.115426:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313223808:12345-0@lo:13: Request processed in 349us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813021.115431:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813021.115449:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313223936 00000100:00100000:3.0:1788813021.115451:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313223936 00000100:00100000:3.0:1788813021.115471:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813021.115478:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10065:x1875706313223936:12345-0@lo:7: 00010000:00080000:0.0:1788813021.117401:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccbea00 x1875706313223808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813021.117428:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313223808:0@lo:13: 00002000:00080000:2.0:1788813021.118538:0:10066:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788813021.118544:0:10066:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788813021.118609:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10065:x1875706313223936:12345-0@lo:7: Request processed in 3129us (3383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813021.118618:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788813021.118644:0:10065:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccbfb80 x1875706313223936/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788813037 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813021.118656:0:10065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875706313223936:0@lo:7: 00000004:00080000:1.0:1788813021.118668:0:10065:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788813021.118699:0:10065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875706313224064:0@lo:5: 00000100:00100000:1.0:1788813021.118729:0:10065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.118759:0:10065:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a749f7900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813021.119174:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313224064 00000100:00100000:0.0:1788813021.119182:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313224064 00000100:00100000:0.0:1788813021.119225:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788813021.119235:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10065:x1875706313224064:12345-0@lo:5: 00002000:00080000:0.0:1788813021.119258:0:8404:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788813021.119310:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10065:x1875706313224064:12345-0@lo:5: Request processed in 76us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813021.119316:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788813021.119346:0:10065:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccbfb80 x1875706313224064/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813037 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813021.119356:0:10065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875706313224064:0@lo:5: 00000004:00080000:1.0:1788813021.119364:0:10065:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788813021.119387:0:10065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875706313224192:0@lo:5: 00000100:00100000:1.0:1788813021.119408:0:10065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.119428:0:10065:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a749f7900 going to sleep for 11 seconds 00000100:00100000:2.0:1788813021.119464:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313224192 00000100:00100000:2.0:1788813021.119468:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313224192 00000100:00100000:2.0:1788813021.119503:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788813021.119510:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10065:x1875706313224192:12345-0@lo:5: 00002000:00080000:2.0:1788813021.119532:0:8403:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1788813021.120987:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:10065:x1875706313224192:12345-0@lo:5: Request processed in 1474us (1574us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788813021.120996:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788813021.121039:0:10065:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccbfb80 x1875706313224192/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813037 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813021.121055:0:10065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10065:1875706313224192:0@lo:5: 00000004:00080000:1.0:1788813021.121067:0:10065:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788813021.121100:0:10065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10065:1875706313224320:0@lo:900: 00000100:00100000:1.0:1788813021.121127:0:10065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813021.121322:0:10065:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a749f7900 going to sleep for 11 seconds 00000001:00080000:3.0:1788813021.126313:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1788813021.126342:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1788813021.126429:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313224320 00000100:00100000:2.0:1788813021.126439:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313224320 00000100:00100000:2.0:1788813021.126505:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788813021.126516:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10065:x1875706313224320:12345-0@lo:900: 00000100:00100000:2.0:1788813021.126609:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10065:x1875706313224320:12345-0@lo:900: Request processed in 96us (5481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813021.126617:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813021.126645:0:10065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10065:1875706313224320:0@lo:900: 00000100:00100000:1.0:1788813021.126798:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10070:x1875706313223680:12345-0@lo:700: Request processed in 13025us (13118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813021.126804:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788813021.126857:0:10070:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccbdf80 x1875706313223680/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788813037 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813021.126864:0:10070:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788813021.126871:0:10070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10070:1875706313223680:0@lo:700: 00000004:02000040:2.0:1788813021.128187:0:10070:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1788813021.134310:0:10070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10070:1875706313224448:0@lo:5: 00000100:00100000:2.0:1788813021.134379:0:10070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813021.134437:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313224448 00000100:00100000:0.0:1788813021.134445:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313224448 00000100:00100000:3.0:1788813021.134490:0:10070:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46c9a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813021.134501:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788813021.134510:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10070:x1875706313224448:12345-0@lo:5: 00002000:00080000:0.0:1788813021.141923:0:8404:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788813021.141961:0:8404:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1788813021.144612:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10070:x1875706313224448:12345-0@lo:5: Request processed in 10096us (10225us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788813021.144624:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788813021.144714:0:10070:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76406680 x1875706313224448/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813037 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813021.144732:0:10070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10070:1875706313224448:0@lo:5: 00000004:00080000:3.0:1788813021.144748:0:10070:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1788813022.052366:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813022.704466:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813022.704580:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301648512 00000100:00100000:1.0:1788813022.704591:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301648512 00000100:00100000:1.0:1788813022.704678:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00100000:1.0:1788813022.704688:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:6239:x1875706301648512:12345-192.168.202.13@tcp:41: 00000004:00000024:1.0:1788813022.704727:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788813022.704804:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:6239:x1875706301648512:12345-192.168.202.13@tcp:41: Request processed in 117us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813022.704812:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00080000:3.0:1788813022.705462:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813022.707370:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813022.707425:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301648640 00000100:00100000:3.0:1788813022.707434:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301648640 00000100:00100000:3.0:1788813022.707566:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:3.0:1788813022.707577:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:6239:x1875706301648640:12345-192.168.202.13@tcp:41: 00000004:00000024:3.0:1788813022.707611:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788813022.707675:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:6239:x1875706301648640:12345-192.168.202.13@tcp:41: Request processed in 100us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813022.707683:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00080000:1.0:1788813022.707966:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788813022.711626:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813022.711726:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301648768 00000100:00100000:3.0:1788813022.711734:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301648768 00000100:00100000:3.0:1788813022.711852:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:3.0:1788813022.711860:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:6239:x1875706301648768:12345-192.168.202.13@tcp:13: 00002000:00000024:3.0:1788813022.711888:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813022.711957:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:6239:x1875706301648768:12345-192.168.202.13@tcp:13: Request processed in 99us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813022.711963:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00080000:1.0:1788813022.712090:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813022.713269:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813022.713395:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301648896 00000100:00100000:3.0:1788813022.713400:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301648896 00000100:00100000:3.0:1788813022.713503:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:3.0:1788813022.713510:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:6239:x1875706301648896:12345-192.168.202.13@tcp:13: 00002000:00000024:3.0:1788813022.713526:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813022.713568:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:6239:x1875706301648896:12345-192.168.202.13@tcp:13: Request processed in 60us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813022.713573:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00080000:1.0:1788813022.713621:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788813023.076158:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813024.100108:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813024.100133:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313224576:0@lo:13: 00000100:00100000:2.0:1788813024.100203:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813024.100296:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313224576 00000100:00100000:1.0:1788813024.100312:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313224576 00000100:00100000:1.0:1788813024.100396:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813024.100408:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64342680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313224576:12345-0@lo:13: 00002000:00000024:1.0:1788813024.100448:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813024.100528:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64342680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313224576:12345-0@lo:13: Request processed in 123us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813024.100535:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788813024.100560:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788813024.100632:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76405f80 x1875706313224576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813024.100648:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313224576:0@lo:13: 00000100:00100000:3.0:1788813024.101134:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313224704:0@lo:13: 00000100:00100000:3.0:1788813024.101200:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813024.101224:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813024.101478:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313224704 00000100:00100000:1.0:1788813024.101487:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313224704 00000100:00100000:1.0:1788813024.101592:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813024.101602:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313224704:12345-0@lo:13: 00002000:00000024:1.0:1788813024.101633:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813024.101677:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313224704:12345-0@lo:13: Request processed in 77us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813024.101683:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788813024.101780:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788813024.102182:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a764c8700 x1875706313224704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813024.102320:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313224704:0@lo:13: 00000001:02000400:3.0:1788813024.381442:0:10156:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788813025.125194:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313224832:0@lo:41: 00000100:00100000:1.0:1788813025.125424:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813025.125597:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313224832 00000100:00100000:3.0:1788813025.125608:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313224832 00000100:00100000:3.0:1788813025.125672:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788813025.125682:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313224832:12345-0@lo:41: 00000004:00000024:3.0:1788813025.125727:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788813025.125782:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313224832:12345-0@lo:41: Request processed in 101us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813025.125789:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788813025.125838:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313224832:0@lo:41: 00010000:00010000:1.0:1788813025.127686:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813025.636214:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813025.636259:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313224960:0@lo:41: 00000100:00100000:0.0:1788813025.636346:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813025.636495:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313224960 00000100:00100000:2.0:1788813025.636505:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313224960 00000100:00100000:3.0:1788813025.640876:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788813025.640907:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313224960:12345-0@lo:41: 00000004:00000024:3.0:1788813025.640977:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788813025.641238:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313224960:12345-0@lo:41: Request processed in 337us (4881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813025.641265:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788813025.641407:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313224960:0@lo:41: 00010000:00010000:0.0:1788813026.148068:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813026.150496:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813026.150525:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313225088:0@lo:13: 00000100:00100000:3.0:1788813026.150626:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813026.151365:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313225088 00000100:00100000:2.0:1788813026.151377:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313225088 00000100:00100000:2.0:1788813026.151533:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788813026.151680:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313225088:12345-0@lo:13: 00002000:00000024:2.0:1788813026.151721:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813026.151875:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313225088:12345-0@lo:13: Request processed in 200us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813026.151883:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788813026.151910:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788813026.151957:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a71411500 x1875706313225088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813026.151969:0:3626:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788813026.151996:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313225088:0@lo:13: 00000100:00100000:3.0:1788813026.152210:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313225216:0@lo:13: 00000100:00100000:3.0:1788813026.152255:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813026.152352:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313225216 00000100:00100000:2.0:1788813026.152357:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313225216 00000100:00100000:2.0:1788813026.152395:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788813026.152402:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1875706313225216:12345-0@lo:13: 00002000:00000024:2.0:1788813026.152414:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813026.152445:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1875706313225216:12345-0@lo:13: Request processed in 43us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813026.152451:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788813026.152502:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788813026.152523:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a64340700 x1875706313225216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813026.152538:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313225216:0@lo:13: 00000100:00100000:3.0:1788813026.152789:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313225344:0@lo:400: 00000100:00100000:3.0:1788813026.152824:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813026.152851:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313225856:0@lo:400: 00000100:00100000:3.0:1788813026.152876:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813026.152896:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313226368:0@lo:400: 00000100:00100000:3.0:1788813026.152957:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813026.152980:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788813026.152986:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313225472:0@lo:400: 00000100:00100000:3.0:1788813026.153013:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813026.153034:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313225984:0@lo:400: 00000100:00100000:3.0:1788813026.153066:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813026.153084:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313226496:0@lo:400: 00000100:00100000:3.0:1788813026.153104:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813026.153133:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313225344 00000100:00100000:3.0:1788813026.153137:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313225344 00000100:00100000:3.0:1788813026.153171:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788813026.153176:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313225344:12345-0@lo:400: 00000100:00100000:3.0:1788813026.153208:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313225344:12345-0@lo:400: Request processed in 32us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.153214:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788813026.153256:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313225856 00000100:00100000:3.0:1788813026.153260:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313225856 00000100:00100000:3.0:1788813026.153287:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788813026.153294:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313225856:12345-0@lo:400: 00000100:00100000:3.0:1788813026.153328:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313225856:12345-0@lo:400: Request processed in 34us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.153334:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788813026.153353:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313225472 00000100:00100000:3.0:1788813026.153357:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313225472 00000100:00100000:3.0:1788813026.153388:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313225984 00000100:00100000:3.0:1788813026.153392:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313225984 00000100:00100000:3.0:1788813026.153412:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313226496 00000100:00100000:3.0:1788813026.153415:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313226496 00000100:00100000:3.0:1788813026.153431:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788813026.153437:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313225472:12345-0@lo:400: 00000100:00100000:3.0:1788813026.153467:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313225472:12345-0@lo:400: Request processed in 31us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.153474:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788813026.153494:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788813026.153495:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313226368 00000100:00100000:3.0:1788813026.153499:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313225984:12345-0@lo:400: 00000100:00100000:2.0:1788813026.153499:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313226368 00000100:00100000:3.0:1788813026.153527:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313225984:12345-0@lo:400: Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813026.153529:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813026.153533:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788813026.153535:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313226368:12345-0@lo:400: 00000100:00100000:3.0:1788813026.153543:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788813026.153548:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313226496:12345-0@lo:400: 00000100:00100000:3.0:1788813026.153574:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313226496:12345-0@lo:400: Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.153580:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788813026.153616:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813026.153620:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813026.153639:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313226368:12345-0@lo:400: Request processed in 104us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.153640:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313225472:0@lo:400: 00000100:00100000:2.0:1788813026.153646:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813026.153650:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313225984:0@lo:400: 00000100:00100000:3.0:1788813026.153918:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313226496:0@lo:400: 00000100:00100000:3.0:1788813026.153927:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313225344:0@lo:400: 00000100:00100000:3.0:1788813026.153953:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313225856:0@lo:400: 00010000:00080000:3.0:1788813026.153964:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76417100 x1875706313226368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813026.153974:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313226368:0@lo:400: 00000100:00100000:3.0:1788813026.154006:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313225728:0@lo:400: 00000100:00100000:3.0:1788813026.154032:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813026.154051:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313226240:0@lo:400: 00000100:00100000:3.0:1788813026.154085:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813026.154154:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788813026.154160:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313225600:0@lo:400: 00000100:00100000:3.0:1788813026.154184:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813026.154201:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313226112:0@lo:400: 00000100:00100000:3.0:1788813026.154238:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813026.154255:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313226624:0@lo:400: 00000100:00100000:3.0:1788813026.154278:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813026.154304:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313225600 00000100:00100000:3.0:1788813026.154308:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313225600 00000100:00100000:3.0:1788813026.154334:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788813026.154341:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313225600:12345-0@lo:400: 00000100:00100000:3.0:1788813026.154378:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313225600:12345-0@lo:400: Request processed in 38us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.154383:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788813026.154398:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313225728 00000100:00100000:3.0:1788813026.154402:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313225728 00000100:00100000:3.0:1788813026.154420:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313226112 00000100:00100000:3.0:1788813026.154423:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313226112 00000100:00100000:3.0:1788813026.154439:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313226624 00000100:00100000:3.0:1788813026.154442:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313226624 00000100:00100000:3.0:1788813026.154456:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788813026.154462:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313225728:12345-0@lo:400: 00000100:00100000:3.0:1788813026.154492:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313225728:12345-0@lo:400: Request processed in 30us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.154498:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788813026.154509:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788813026.154515:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313226112:12345-0@lo:400: 00000100:00100000:3.0:1788813026.154550:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313226112:12345-0@lo:400: Request processed in 35us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.154556:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788813026.154568:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788813026.154574:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313226624:12345-0@lo:400: 00000100:00100000:3.0:1788813026.154599:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313226624:12345-0@lo:400: Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.154605:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788813026.154623:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788813026.154646:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313225600:0@lo:400: 00010000:00080000:3.0:1788813026.154827:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76414700 x1875706313226112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813026.154838:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313226112:0@lo:400: 00010000:00080000:3.0:1788813026.154848:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76416a00 x1875706313226624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813026.154856:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313226624:0@lo:400: 00000100:00100000:3.0:1788813026.154868:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313225728:0@lo:400: 00000100:00100000:0.0:1788813026.154981:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313226240 00000100:00100000:0.0:1788813026.154988:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313226240 00000100:00100000:0.0:1788813026.155045:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788813026.155055:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313226240:12345-0@lo:400: 00000100:00100000:0.0:1788813026.155106:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313226240:12345-0@lo:400: Request processed in 52us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813026.155113:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788813026.156090:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788813026.156123:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76415c00 x1875706313226240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813026.156136:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313226240:0@lo:400: 00000100:00100000:0.0:1788813026.178847:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813026.178883:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813026.178908:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813026.178927:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301649024 00000100:00100000:0.0:1788813026.178972:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813026.178999:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301649024 00000100:00100000:0.0:1788813026.179006:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813026.179028:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301649280 00000100:00100000:0.0:1788813026.179033:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301649280 00000100:00100000:1.0:1788813026.179084:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 191 00000100:00100000:0.0:1788813026.179085:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301649152 00000100:00100000:0.0:1788813026.179089:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301649152 00000100:00100000:1.0:1788813026.179105:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:2397:x1875706301649024:12345-192.168.202.13@tcp:400: 00000100:00100000:0.0:1788813026.179116:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 37 00000100:00100000:0.0:1788813026.179122:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301649280:12345-192.168.202.13@tcp:400: 00000100:00100000:2.0:1788813026.179166:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301649536 00000100:00100000:2.0:1788813026.179172:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301649536 00000100:00100000:0.0:1788813026.179194:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301649280:12345-192.168.202.13@tcp:400: Request processed in 71us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813026.179214:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 37 00000100:00100000:2.0:1788813026.179218:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301649408 00000100:00100000:2.0:1788813026.179223:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301649408 00000100:00100000:0.0:1788813026.179250:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 38 00000100:00100000:1.0:1788813026.179257:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:2397:x1875706301649024:12345-192.168.202.13@tcp:400: Request processed in 159us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813026.179261:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301649152:12345-192.168.202.13@tcp:400: 00000100:00100000:1.0:1788813026.179274:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 191 00000100:00100000:0.0:1788813026.179291:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301649152:12345-192.168.202.13@tcp:400: Request processed in 35us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813026.179297:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 38 00000100:00100000:1.0:1788813026.179335:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:2.0:1788813026.179344:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:1.0:1788813026.179347:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301649536:12345-192.168.202.13@tcp:400: 00000100:00100000:2.0:1788813026.179358:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301649408:12345-192.168.202.13@tcp:400: 00000100:00100000:1.0:1788813026.179383:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301649536:12345-192.168.202.13@tcp:400: Request processed in 40us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813026.179391:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:2.0:1788813026.179397:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301649408:12345-192.168.202.13@tcp:400: Request processed in 43us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813026.179405:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00080000:1.0:1788813026.179436:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813026.179443:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813026.179445:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813026.179448:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:1.0:1788813026.768923:0:10303:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7ca06780 20000000:00000080:1.0:1788813026.769117:0:10303:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff948943418400 uarg=0000000000000000 20000000:01000000:1.0:1788813026.769175:0:10303:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788813026.769178:0:10303:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788813026.769182:0:10303:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788813026.769187:0:10303:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788813026.769193:0:10303:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788813026.769285:0:10303:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788813026.769289:0:10303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788813026.769784:0:10304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1788813026.770425:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1788813026.770463:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1788813026.770479:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1788813026.770488:0:10303:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788813026.770490:0:10303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788813026.770823:0:10305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1788813026.771276:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1788813026.771296:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1788813026.771310:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1788813026.771318:0:10303:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788813026.771320:0:10303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788813026.771598:0:10306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1788813026.771773:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1788813026.771794:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1788813026.771807:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1788813026.771817:0:10303:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788813026.771819:0:10303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788813026.772380:0:10307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1788813026.772544:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1788813026.772568:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1788813026.772583:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1788813026.772593:0:10303:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788813026.772595:0:10303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788813026.772886:0:10308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1788813026.773118:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1788813026.773140:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1788813026.773154:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:1.0:1788813026.773168:0:10303:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788813026.773194:0:10303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702a18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773216:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f8400/0xf32533d6ff7028b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7028ac expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773235:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a821e4e00/0xf32533d6ff7028dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7028d6 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773245:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f8800/0xf32533d6ff70291c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729554 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773254:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a821e4200/0xf32533d6ff702923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072955b expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773274:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702962 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773281:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702970 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773289:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f9800/0xf32533d6ff702985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70297e expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773297:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a6fc09e00/0xf32533d6ff7029a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70299a expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773304:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff7029cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7029c4 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773312:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff7029e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7029e0 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773320:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702a03 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773329:0:10303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702a18 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773379:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702a03 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773398:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702a03 expref: 23 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.773427:0:10303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76415180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313226752:0@lo:104: 00000100:00100000:1.0:1788813026.773510:0:10303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813026.773694:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff7029e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7029e0 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773704:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff7029e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7029e0 expref: 23 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.773713:0:10303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313226880:0@lo:104: 00000100:00100000:1.0:1788813026.773737:0:10303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813026.773836:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff7029cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7029c4 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.773844:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff7029cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7029c4 expref: 23 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.773853:0:10303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76415c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227008:0@lo:104: 00000100:00100000:1.0:1788813026.773874:0:10303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813026.773959:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313226752 00000100:00100000:3.0:1788813026.773969:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313226752 00000100:00100000:3.0:1788813026.774012:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313226880 00000100:00100000:3.0:1788813026.774015:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313226880 00000100:00100000:3.0:1788813026.774031:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788813026.774042:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:10303:x1875706313226752:12345-0@lo:104: 00010000:00010000:3.0:1788813026.774057:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702a0a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.774165:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813026.774172:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:10303:x1875706313226752:12345-0@lo:104: Request processed in 132us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.774180:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788813026.774199:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788813026.774205:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:10303:x1875706313226880:12345-0@lo:104: 00010000:00010000:3.0:1788813026.774213:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8c00/0xf32533d6ff7029e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7029e7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.774323:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a6fc09e00/0xf32533d6ff7029a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff70299a expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.774333:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a6fc09e00/0xf32533d6ff7029a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff70299a expref: 23 pid: 6488 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.774342:0:10303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227136:0@lo:104: 00000100:00100000:1.0:1788813026.774369:0:10303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813026.774409:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f9800/0xf32533d6ff702985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff70297e expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.774427:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a7b5f9800/0xf32533d6ff702985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff70297e expref: 23 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.774435:0:10303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227264:0@lo:104: 00010000:00010000:1.0:1788813026.774462:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702970 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.774470:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702977 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702970 expref: 23 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.774478:0:10303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227392:0@lo:104: 00010000:00010000:1.0:1788813026.774500:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702962 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.774508:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702962 expref: 23 pid: 6488 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.774516:0:10303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76415500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227520:0@lo:104: 00010000:00010000:1.0:1788813026.774554:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a821e4200/0xf32533d6ff702923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072955b expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.774565:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a821e4200/0xf32533d6ff702923 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072955b expref: 9 pid: 6488 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.774576:0:10303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227648:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813026.774653:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f8800/0xf32533d6ff70291c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729554 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.774671:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a7b5f8800/0xf32533d6ff70291c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729554 expref: 9 pid: 6486 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.774681:0:10303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227776:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813026.774714:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a821e4e00/0xf32533d6ff7028dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7028d6 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.774722:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a821e4e00/0xf32533d6ff7028dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7028d6 expref: 23 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.774731:0:10303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227904:0@lo:104: 00010000:00010000:1.0:1788813026.774756:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f8400/0xf32533d6ff7028b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7028ac expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.774764:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a7b5f8400/0xf32533d6ff7028b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7028ac expref: 23 pid: 6487 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.774772:0:10303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313228032:0@lo:104: 00000100:00100000:1.0:1788813026.774789:0:10303:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6087eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813026.774817:0:10303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76415180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313226752:0@lo:104: 00000100:00100000:1.0:1788813026.774827:0:10303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313226880:0@lo:104: 00000100:00100000:2.0:1788813026.774903:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313227008 00000100:00100000:2.0:1788813026.774909:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313227008 00000100:00100000:2.0:1788813026.774967:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788813026.774988:0:6476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813026.775002:0:6476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813026.775021:0:6476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813026.775031:0:6476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813026.775038:0:6476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813026.775046:0:6476:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788813026.775053:0:6476:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1788813026.775133:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813026.775142:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702a0a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.775151:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9600 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813026.775155:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702a0a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.775164:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702a0a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813026.775171:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702a0a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813026.775177:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813026.775209:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702a0a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.775215:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813026.775248:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702a0a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.775265:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702a0a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.775282:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813026.775285:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8c00/0xf32533d6ff7029e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7029e7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.775290:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8c00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813026.775293:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8c00/0xf32533d6ff7029e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7029e7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.775300:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8c00/0xf32533d6ff7029e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7029e7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813026.775306:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8c00/0xf32533d6ff7029e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7029e7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813026.775311:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813026.775326:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8c00/0xf32533d6ff7029e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7029e7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.775332:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813026.775350:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8c00/0xf32533d6ff7029e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7029e7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.775356:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8c00/0xf32533d6ff7029e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7029e7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.775365:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813026.775372:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813026.775374:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813026.775530:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813026.775545:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313228160:0@lo:103: 00000100:00100000:0.0:1788813026.775584:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813026.775616:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313228288:0@lo:103: 00000100:00100000:0.0:1788813026.775652:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813026.775693:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313228160 00000100:00100000:0.0:1788813026.775697:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313228160 00010000:00010000:0.0:1788813026.775721:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702a03 expref: 24 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813026.775745:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313228288 00000100:00100000:0.0:1788813026.775748:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313228288 00010000:00010000:0.0:1788813026.775760:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff7029e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7029e0 expref: 25 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813026.775779:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788813026.775786:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50686050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+25:3625:x1875706313228160:12345-0@lo:103: 00010000:00010000:0.0:1788813026.775800:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813026.775807:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702a03 expref: 25 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.775820:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702a03 expref: 25 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.775836:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702a03 expref: 25 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.775851:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813026.775889:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50686050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3625:x1875706313228160:12345-0@lo:103: Request processed in 103us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813026.775896:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788813026.775973:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788813026.775980:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943530e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:3627:x1875706313228288:12345-0@lo:103: 00010000:00010000:0.0:1788813026.775986:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813026.775990:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff7029e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7029e0 expref: 23 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.775998:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff7029e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7029e0 expref: 23 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.776009:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff7029e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7029e0 expref: 23 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.776017:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813026.776040:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943530e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:3627:x1875706313228288:12345-0@lo:103: Request processed in 61us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813026.776046:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788813026.776082:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313228160:0@lo:103: 00000100:00100000:0.0:1788813026.776109:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313228288:0@lo:103: 00010000:00010000:3.0:1788813026.776364:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788813026.776373:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:10303:x1875706313226880:12345-0@lo:104: Request processed in 2168us (2634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.776381:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788813026.776398:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313227136 00000100:00100000:3.0:1788813026.776401:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313227136 00000100:00100000:3.0:1788813026.776416:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313227264 00000100:00100000:3.0:1788813026.776419:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313227264 00000100:00100000:3.0:1788813026.776428:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313227392 00000100:00100000:3.0:1788813026.776436:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313227392 00000100:00100000:3.0:1788813026.776448:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313227520 00000100:00100000:3.0:1788813026.776450:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313227520 00000100:00100000:3.0:1788813026.776459:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313227904 00000100:00100000:3.0:1788813026.776461:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313227904 00000100:00100000:3.0:1788813026.776471:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313228032 00000100:00100000:3.0:1788813026.776473:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313228032 00000100:00100000:3.0:1788813026.776483:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788813026.776489:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+9:10303:x1875706313227008:12345-0@lo:104: 00010000:00010000:3.0:1788813026.776499:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7029c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7029cb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.776567:0:10303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76415c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227008:0@lo:104: 00010000:00010000:0.0:1788813026.776618:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813026.776630:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813026.776637:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+9:10303:x1875706313227008:12345-0@lo:104: Request processed in 148us (2761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.776643:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788813026.776648:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813026.776654:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7029c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7029cb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813026.776659:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788813026.776661:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08a00 already unused, calling callback (ffffffffc13c1c20) 00000100:00100000:3.0:1788813026.776665:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccb4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+8:10303:x1875706313227136:12345-0@lo:104: 10000000:00010000:1.0:1788813026.776670:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7029c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7029cb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.776673:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff70299a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7029a1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.776679:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7029c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7029cb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813026.776686:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7029c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7029cb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813026.776693:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813026.776725:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7029c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7029cb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.776732:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813026.776744:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7029c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7029cb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.776750:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7029c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7029cb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.776761:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813026.776762:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813026.776764:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813026.776808:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313228416:0@lo:103: 00000100:00100000:0.0:1788813026.776837:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813026.776917:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313228416 00000100:00100000:1.0:1788813026.776921:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313228416 00010000:00010000:1.0:1788813026.776985:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff7029cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7029c4 expref: 22 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.777009:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813026.777015:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:3628:x1875706313228416:12345-0@lo:103: 00010000:00010000:1.0:1788813026.777024:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813026.777030:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813026.777034:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccb4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+8:10303:x1875706313227136:12345-0@lo:104: Request processed in 371us (2665us total) trans 0 rc 0/0 00010000:00010000:1.0:1788813026.777034:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff7029cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7029c4 expref: 22 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813026.777040:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788813026.777044:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff7029cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7029c4 expref: 22 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.777055:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff7029cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7029c4 expref: 22 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.777066:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813026.777093:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:3628:x1875706313228416:12345-0@lo:103: Request processed in 78us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813026.777099:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813026.777127:0:10303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227136:0@lo:104: 00000100:00100000:3.0:1788813026.777189:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788813026.777192:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313228416:0@lo:103: 00000100:00100000:3.0:1788813026.777195:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64340700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+7:10303:x1875706313227264:12345-0@lo:104: 00010000:00010000:3.0:1788813026.777204:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a44cda000/0xf32533d6ff70297e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702985 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.777271:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788813026.777276:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64340700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+7:10303:x1875706313227264:12345-0@lo:104: Request processed in 82us (2288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.777282:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813026.777295:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788813026.777301:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+6:10303:x1875706313227392:12345-0@lo:104: 00010000:00010000:3.0:1788813026.777309:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a4151d200/0xf32533d6ff702970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702977 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.777322:0:10303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227264:0@lo:104: 00010000:00010000:3.0:1788813026.777347:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788813026.777350:0:10303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227392:0@lo:104: 00000100:00100000:3.0:1788813026.777352:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+6:10303:x1875706313227392:12345-0@lo:104: Request processed in 52us (2349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.777358:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788813026.777370:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788813026.777377:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+5:10303:x1875706313227520:12345-0@lo:104: 00010000:00010000:3.0:1788813026.777385:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff702962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702969 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.777421:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788813026.777426:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+5:10303:x1875706313227520:12345-0@lo:104: Request processed in 51us (2405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.777432:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788813026.777445:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788813026.777451:0:10303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76415500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227520:0@lo:104: 00000100:00100000:3.0:1788813026.777452:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:10303:x1875706313227904:12345-0@lo:104: 00010000:00010000:3.0:1788813026.777460:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff7028d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7028dd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.777506:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788813026.777512:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:10303:x1875706313227904:12345-0@lo:104: Request processed in 61us (2480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.777518:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788813026.777530:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788813026.777605:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943526a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:10303:x1875706313228032:12345-0@lo:104: 00010000:00010000:3.0:1788813026.777615:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7028ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7028b3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.777622:0:10303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227904:0@lo:104: 00010000:00010000:3.0:1788813026.777656:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788813026.777661:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943526a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:10303:x1875706313228032:12345-0@lo:104: Request processed in 127us (2621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.777667:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788813026.777667:0:10303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313228032:0@lo:104: 00010000:00010000:3.0:1788813026.777755:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788813026.777760:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff70299a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7029a1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.777765:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb400 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813026.777767:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff70299a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7029a1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.777772:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff70299a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7029a1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813026.777776:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff70299a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7029a1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813026.777780:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813026.777808:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff70299a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7029a1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.777815:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788813026.777838:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313228544:0@lo:103: 00010000:00010000:3.0:1788813026.777840:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff70299a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7029a1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.777847:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff70299a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7029a1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.777859:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:0.0:1788813026.777865:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813026.777925:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a44cda000/0xf32533d6ff70297e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702985 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.777952:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda000 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813026.777957:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a44cda000/0xf32533d6ff70297e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702985 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.777965:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a44cda000/0xf32533d6ff70297e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702985 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813026.777971:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a44cda000/0xf32533d6ff70297e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702985 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813026.777976:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813026.778000:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a44cda000/0xf32533d6ff70297e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702985 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778007:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813026.778024:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a44cda000/0xf32533d6ff70297e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702985 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.778036:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313228672:0@lo:103: 00010000:00010000:3.0:1788813026.778138:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a44cda000/0xf32533d6ff70297e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702985 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778150:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788813026.778153:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a4151d200/0xf32533d6ff702970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702977 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778158:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4151d200 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813026.778161:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a4151d200/0xf32533d6ff702970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702977 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778169:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4151d200/0xf32533d6ff702970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702977 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813026.778175:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4151d200/0xf32533d6ff702970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702977 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813026.778179:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813026.778197:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a4151d200/0xf32533d6ff702970 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702977 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778203:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813026.778216:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a4151d200/0xf32533d6ff702970 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702977 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778237:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4151d200/0xf32533d6ff702970 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702977 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813026.778246:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00010000:00010000:3.0:1788813026.778247:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788813026.778255:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff702962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702969 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778261:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda400 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813026.778264:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff702962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702969 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778271:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff702962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702969 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813026.778278:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff702962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702969 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813026.778283:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813026.778297:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff702962 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702969 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778302:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813026.778307:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff702962 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702969 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778314:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff702962 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702969 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778322:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813026.778325:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff7028d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7028dd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.778328:0:10303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227648:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813026.778331:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdbe00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813026.778335:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff7028d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7028dd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813026.778337:0:10303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875706313227776:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813026.778352:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff7028d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7028dd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813026.778358:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff7028d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7028dd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813026.778364:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813026.778388:0:10303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702a18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778432:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff7028d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7028dd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778438:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788813026.778446:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313228544 00010000:00010000:3.0:1788813026.778447:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff7028d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7028dd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813026.778452:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313228544 00010000:00010000:3.0:1788813026.778454:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff7028d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7028dd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778462:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813026.778465:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7028ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7028b3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778471:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4000 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813026.778474:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7028ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7028b3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.778474:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a6fc09e00/0xf32533d6ff7029a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70299a expref: 21 pid: 6488 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778481:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7028ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7028b3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813026.778487:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7028ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7028b3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813026.778493:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301649664 00000100:00100000:2.0:1788813026.778496:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301649664 10000000:01000000:3.0:1788813026.778499:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788813026.778507:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a821e4200/0xf32533d6ff702923 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072955b expref: 10 pid: 6488 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778511:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7028ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7028b3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778516:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813026.778521:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7028ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7028b3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778527:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a821e4000/0xf32533d6ff7028ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7028b3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813026.778586:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788813026.778595:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943532300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:3625:x1875706313228544:12345-0@lo:103: 00010000:00010000:0.0:1788813026.778606:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813026.778610:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813026.778612:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813026.778612:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a6fc09e00/0xf32533d6ff7029a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70299a expref: 21 pid: 6488 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.778614:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813026.778620:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813026.778623:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a6fc09e00/0xf32533d6ff7029a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff70299a expref: 21 pid: 6488 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813026.778629:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313228800:0@lo:103: 00010000:00010000:0.0:1788813026.778635:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc09e00/0xf32533d6ff7029a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff70299a expref: 21 pid: 6488 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.778645:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813026.778656:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813026.778664:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943532300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:3625:x1875706313228544:12345-0@lo:103: Request processed in 72us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813026.778670:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788813026.778775:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813026.778781:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313228928:0@lo:103: 00000100:00100000:0.0:1788813026.778782:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313228800 00000100:00100000:0.0:1788813026.778785:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313228800 00010000:00010000:0.0:1788813026.778798:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702977 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702970 expref: 20 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813026.778804:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813026.778809:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313228928 00000100:00100000:0.0:1788813026.778811:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313228928 00010000:00010000:3.0:1788813026.778820:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813026.778821:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702962 expref: 21 pid: 6488 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813026.778833:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:0.0:1788813026.778839:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943531f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:612bc516-9aee-451d-b7c0-359fff7db073+10:2396:x1875706301649664:12345-192.168.202.13@tcp:103: 00010000:00010000:0.0:1788813026.778847:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813026.778856:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a821e4200/0xf32533d6ff702923 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072955b expref: 10 pid: 6488 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.778865:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a821e4200/0xf32533d6ff702923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072955b expref: 10 pid: 6488 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.778877:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e4200/0xf32533d6ff702923 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072955b expref: 10 pid: 6488 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.778886:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813026.778953:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943531f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:612bc516-9aee-451d-b7c0-359fff7db073+9:2396:x1875706301649664:12345-192.168.202.13@tcp:103: Request processed in 113us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813026.778960:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:0.0:1788813026.778974:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788813026.778979:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:3627:x1875706313228800:12345-0@lo:103: 00010000:00010000:0.0:1788813026.778987:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813026.778991:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702977 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702970 expref: 21 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.778999:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702970 expref: 21 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.779008:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702977 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702970 expref: 21 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.779015:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813026.779041:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:3627:x1875706313228800:12345-0@lo:103: Request processed in 62us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813026.779046:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788813026.779060:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788813026.779071:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:3627:x1875706313228928:12345-0@lo:103: 00010000:00010000:0.0:1788813026.779078:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813026.779082:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702962 expref: 19 pid: 6488 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.779090:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702962 expref: 19 pid: 6488 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.779099:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702969 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702962 expref: 19 pid: 6488 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.779107:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813026.779127:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:3627:x1875706313228928:12345-0@lo:103: Request processed in 57us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813026.779132:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788813026.779151:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813026.779176:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313229184:0@lo:103: 00000100:00100000:2.0:1788813026.779270:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313228672 00000100:00100000:2.0:1788813026.779274:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313228672 00010000:00010000:2.0:1788813026.779290:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f9800/0xf32533d6ff702985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70297e expref: 18 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813026.779316:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788813026.779321:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50686450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:3626:x1875706313228672:12345-0@lo:103: 00010000:00010000:2.0:1788813026.779328:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813026.779331:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f9800/0xf32533d6ff702985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70297e expref: 18 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.779340:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f9800/0xf32533d6ff702985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff70297e expref: 18 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.779350:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f9800/0xf32533d6ff702985 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff70297e expref: 18 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.779374:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813026.779398:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50686450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:3626:x1875706313228672:12345-0@lo:103: Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813026.779404:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788813026.779490:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813026.779525:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313228672:0@lo:103: 00000100:00100000:0.0:1788813026.779536:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813026.779542:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313229056:0@lo:103: 00000100:00100000:0.0:1788813026.779562:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813026.779586:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313229184 00000100:00100000:0.0:1788813026.779590:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313229184 00010000:00010000:0.0:1788813026.779605:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f8400/0xf32533d6ff7028b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7028ac expref: 17 pid: 6487 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813026.779630:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313229056 00000100:00100000:0.0:1788813026.779633:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313229056 00010000:00010000:0.0:1788813026.779652:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a821e4e00/0xf32533d6ff7028dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7028d6 expref: 18 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813026.779664:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788813026.779668:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:3626:x1875706313229184:12345-0@lo:103: 00010000:00010000:0.0:1788813026.779674:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813026.779678:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f8400/0xf32533d6ff7028b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7028ac expref: 18 pid: 6487 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.779686:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f8400/0xf32533d6ff7028b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7028ac expref: 18 pid: 6487 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.779696:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8400/0xf32533d6ff7028b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7028ac expref: 18 pid: 6487 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.779704:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813026.779731:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:3626:x1875706313229184:12345-0@lo:103: Request processed in 62us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813026.779736:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788813026.779749:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788813026.779754:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:3626:x1875706313229056:12345-0@lo:103: 00010000:00010000:0.0:1788813026.779761:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813026.779764:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a821e4e00/0xf32533d6ff7028dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7028d6 expref: 16 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.779772:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a821e4e00/0xf32533d6ff7028dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7028d6 expref: 16 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.779781:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e4e00/0xf32533d6ff7028dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7028d6 expref: 16 pid: 6486 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813026.779799:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813026.779824:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:3626:x1875706313229056:12345-0@lo:103: Request processed in 70us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813026.779830:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788813026.779865:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313228928:0@lo:103: 00000100:00100000:0.0:1788813026.779873:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313228800:0@lo:103: 00000100:00100000:0.0:1788813026.779892:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313228544:0@lo:103: 00000100:00100000:0.0:1788813026.779906:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313229056:0@lo:103: 00000100:00100000:0.0:1788813026.779911:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313229184:0@lo:103: 00000100:00100000:0.0:1788813026.782170:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813026.782277:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301649792 00000100:00100000:2.0:1788813026.782289:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301649792 00010000:00010000:2.0:1788813026.782334:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f8800/0xf32533d6ff70291c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729554 expref: 9 pid: 6486 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813026.782404:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 34 00000100:00100000:2.0:1788813026.782415:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943533b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:612bc516-9aee-451d-b7c0-359fff7db073+9:2396:x1875706301649792:12345-192.168.202.13@tcp:103: 00010000:00010000:2.0:1788813026.782432:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813026.782438:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f8800/0xf32533d6ff70291c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729554 expref: 9 pid: 6486 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.782453:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f8800/0xf32533d6ff70291c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729554 expref: 9 pid: 6486 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.782489:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8800/0xf32533d6ff70291c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729554 expref: 9 pid: 6486 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.782509:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702a18 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.782519:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702a18 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.782540:0:9502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702a18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.782547:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702a18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.782554:0:9502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702a18 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.782562:0:9502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702a18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.782568:0:9502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813026.782574:0:9502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702a18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.782583:0:9502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702a18 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.782606:0:9502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702a18 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.782630:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813026.782767:0:10303:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702a18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.782788:0:10303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702a18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813026.782795:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702a18 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813026.783830:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943533b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:612bc516-9aee-451d-b7c0-359fff7db073+8:2396:x1875706301649792:12345-192.168.202.13@tcp:103: Request processed in 1411us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813026.783840:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 34 00000100:00100000:3.0:1788813026.896073:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813026.896166:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301649920 00000100:00100000:1.0:1788813026.896175:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301649920 00000100:00100000:2.0:1788813026.896248:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 192 00000100:00100000:2.0:1788813026.896260:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+8:6158:x1875706301649920:12345-192.168.202.13@tcp:101: 00010000:00010000:2.0:1788813026.896275:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813026.896291:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc09400/0xf32533d6ff702a1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a07295cb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.896319:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc09400/0xf32533d6ff702a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07295cb expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.896331:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc09400/0xf32533d6ff702a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07295cb expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813026.896339:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09400, rc 0) 00000100:00100000:2.0:1788813026.896389:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+9:6158:x1875706301649920:12345-192.168.202.13@tcp:101: Request processed in 133us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813026.896394:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 192 00000100:00100000:3.0:1788813026.899080:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813026.899276:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301650048 00000100:00100000:1.0:1788813026.899286:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301650048 00000100:00100000:1.0:1788813026.899332:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 193 00000100:00100000:1.0:1788813026.899339:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+9:6158:x1875706301650048:12345-192.168.202.13@tcp:501: 00000100:00100000:1.0:1788813026.899458:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+9:6158:x1875706301650048:12345-192.168.202.13@tcp:501: Request processed in 120us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813026.899463:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 193 00000100:00100000:0.0:1788813026.900607:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813026.900645:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301650176 00000100:00100000:2.0:1788813026.900652:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301650176 00000100:00100000:2.0:1788813026.900689:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 194 00000100:00100000:2.0:1788813026.900699:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+9:6158:x1875706301650176:12345-192.168.202.13@tcp:503: 00000100:00100000:2.0:1788813026.900803:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+9:6158:x1875706301650176:12345-192.168.202.13@tcp:503: Request processed in 105us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813026.900818:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 194 00000100:00100000:2.0:1788813026.911352:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813026.911514:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301650304 00000100:00100000:3.0:1788813026.911524:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301650304 00000100:00100000:3.0:1788813026.911614:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 195 00000100:00100000:3.0:1788813026.911626:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+9:6633:x1875706301650304:12345-192.168.202.13@tcp:502: 00000100:00100000:3.0:1788813026.911809:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+9:6633:x1875706301650304:12345-192.168.202.13@tcp:502: Request processed in 185us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.911820:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 195 00000100:00100000:3.0:1788813026.918134:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813026.918309:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301650432 00000100:00100000:2.0:1788813026.918321:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301650432 00000100:00100000:2.0:1788813026.918374:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 196 00000100:00100000:2.0:1788813026.918386:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+9:6633:x1875706301650432:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813026.918551:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+9:6633:x1875706301650432:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 167us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813026.918560:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 196 00000100:00100000:0.0:1788813026.922819:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813026.922896:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301650560 00000100:00100000:3.0:1788813026.922907:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301650560 00000100:00100000:3.0:1788813026.923005:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 197 00000100:00100000:3.0:1788813026.923016:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+9:6158:x1875706301650560:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813026.923037:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813026.923057:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a4151d200/0xf32533d6ff702a26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a07295d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.923085:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a4151d200/0xf32533d6ff702a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07295d2 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.923094:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a4151d200/0xf32533d6ff702a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07295d2 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813026.923102:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4151d200, rc 0) 00000100:00100000:3.0:1788813026.923149:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+10:6158:x1875706301650560:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 Request processed in 136us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813026.923156:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 197 00000100:00100000:3.0:1788813026.924686:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813026.924771:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301650688 00000100:00100000:2.0:1788813026.924778:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301650688 00000100:00100000:2.0:1788813026.924816:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 198 00000100:00100000:2.0:1788813026.924822:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:6158:x1875706301650688:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813026.924915:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:6158:x1875706301650688:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 Request processed in 93us (236us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788813026.924921:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 198 00010000:00010000:0.0:1788813027.172131:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788813027.177065:0:8399:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000001:00080000:2.0:1788813027.177430:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1788813028.196111:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788813028.311846:0:10357:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc57d16b0 20000000:00000080:2.0:1788813028.311866:0:10357:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9489433d2800 uarg=0000000000000000 20000000:01000000:2.0:1788813028.311916:0:10357:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788813028.311922:0:10357:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788813028.311927:0:10357:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788813028.312229:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788813028.312361:0:10357:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788813028.315342:0:10357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788813028.315383:0:10357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788813028.315399:0:10357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788813028.315430:0:10357:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788813028.315449:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a6fc08800/0xf32533d6ff702a2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.315468:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a821e5200/0xf32533d6ff70278d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702786 expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.315475:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a821e4a00/0xf32533d6ff702820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702819 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.315482:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a44cda200/0xf32533d6ff702874 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff70286d expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.315488:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a821e5a00/0xf32533d6ff7028cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7028c8 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.315498:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f9c00/0xf32533d6ff702931 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729593 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.315505:0:10357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948a6fc08800/0xf32533d6ff702a2d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.315556:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f9c00/0xf32533d6ff702931 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729593 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.315572:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a7b5f9c00/0xf32533d6ff702931 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729593 expref: 9 pid: 6486 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813028.315588:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943527b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875706313229312:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813028.315746:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a821e5a00/0xf32533d6ff7028cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff7028c8 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.315765:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a821e5a00/0xf32533d6ff7028cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff7028c8 expref: 14 pid: 6488 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813028.315776:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875706313229440:0@lo:104: 00000100:00100000:2.0:1788813028.315816:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813028.315856:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a44cda200/0xf32533d6ff702874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff70286d expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.315866:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a44cda200/0xf32533d6ff702874 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff70286d expref: 14 pid: 6486 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813028.315869:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313229440 00000100:00100000:2.0:1788813028.315878:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875706313229568:0@lo:104: 00000100:00100000:1.0:1788813028.315879:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313229440 00000100:00100000:2.0:1788813028.315910:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813028.315980:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788813028.315992:0:10309:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:1.0:1788813028.315994:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313229568 00000100:00100000:1.0:1788813028.315998:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313229568 00000100:00100000:2.0:1788813028.316004:0:10309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788813028.316019:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788813028.316020:0:10309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:10357:x1875706313229440:12345-0@lo:104: 00000100:00100000:1.0:1788813028.316026:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:10357:x1875706313229568:12345-0@lo:104: 00010000:00010000:1.0:1788813028.316038:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff70286d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702874 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.316039:0:10309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff7028c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7028cf expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813028.316103:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813028.316109:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:10357:x1875706313229568:12345-0@lo:104: Request processed in 85us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813028.316127:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1788813028.316382:0:10309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788813028.316392:0:10309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:10357:x1875706313229440:12345-0@lo:104: Request processed in 375us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813028.316399:0:10309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1788813028.316409:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813028.316419:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff70286d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702874 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.316428:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4151c800 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813028.316432:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff70286d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702874 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.316442:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff70286d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702874 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813028.316457:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff70286d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702874 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813028.316463:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788813028.316502:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff70286d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702874 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.316525:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813028.316550:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff70286d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702874 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.316557:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4151c800/0xf32533d6ff70286d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702874 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813028.316566:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313229696:0@lo:103: 00010000:00010000:0.0:1788813028.316574:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813028.316579:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff7028c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff7028cf expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.316586:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4151ce00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813028.316589:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff7028c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff7028cf expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813028.316597:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813028.316603:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff7028c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff7028cf expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813028.316611:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff7028c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff7028cf expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.316616:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a821e4a00/0xf32533d6ff702820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702819 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.316629:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a821e4a00/0xf32533d6ff702820 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702819 expref: 14 pid: 6488 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813028.316631:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788813028.316650:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875706313229824:0@lo:104: 00010000:00010000:0.0:1788813028.316665:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff7028c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7028cf expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813028.316675:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813028.316676:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813028.316691:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff7028c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7028cf expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.316700:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff7028c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff7028cf expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813028.316708:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313229824 00010000:00010000:0.0:1788813028.316712:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813028.316713:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313229824 00010000:00010000:2.0:1788813028.316715:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a821e5200/0xf32533d6ff70278d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702786 expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.316716:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813028.316721:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813028.316727:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a821e5200/0xf32533d6ff70278d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702786 expref: 14 pid: 6486 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813028.316736:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313229952:0@lo:103: 00000100:00100000:1.0:1788813028.316738:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788813028.316740:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875706313230080:0@lo:104: 00000100:00100000:1.0:1788813028.316748:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:10357:x1875706313229824:12345-0@lo:104: 00010000:00010000:1.0:1788813028.316755:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff702819 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702820 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813028.316786:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813028.316789:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813028.316796:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813028.316804:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:10357:x1875706313229824:12345-0@lo:104: Request processed in 57us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813028.316809:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788813028.316822:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313230080 00000100:00100000:1.0:1788813028.316825:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313230080 00010000:00010000:3.0:1788813028.316827:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813028.316839:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff702819 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702820 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813028.316842:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1788813028.316853:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5800 already unused, calling callback (ffffffffc13c1c20) 00000100:00100000:1.0:1788813028.316854:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:10357:x1875706313230080:12345-0@lo:104: 00010000:00010000:1.0:1788813028.316862:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff702786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70278d expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813028.316865:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff702819 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702820 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813028.316881:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff702819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702820 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813028.316887:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff702819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702820 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813028.316891:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788813028.316913:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff702819 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702820 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813028.316923:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813028.316961:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff702819 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702820 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813028.316970:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a821e5800/0xf32533d6ff702819 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702820 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813028.316981:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813028.316983:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813028.316984:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813028.316992:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813028.317030:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313229696 00000100:00100000:3.0:1788813028.317034:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313229696 00010000:00010000:3.0:1788813028.317054:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a44cda200/0xf32533d6ff702874 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70286d expref: 15 pid: 6486 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813028.317074:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313229952 00000100:00100000:3.0:1788813028.317077:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313229952 00010000:00010000:3.0:1788813028.317088:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a821e5a00/0xf32533d6ff7028cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7028c8 expref: 16 pid: 6488 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813028.317113:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788813028.317120:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:3627:x1875706313229696:12345-0@lo:103: 00010000:00010000:3.0:1788813028.317131:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813028.317136:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a44cda200/0xf32533d6ff702874 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff70286d expref: 16 pid: 6486 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813028.317145:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a44cda200/0xf32533d6ff702874 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff70286d expref: 16 pid: 6486 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813028.317160:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813028.317888:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813028.317910:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313230208:0@lo:103: 00000100:00100000:2.0:1788813028.317915:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875706313229440:0@lo:104: 00010000:00010000:1.0:1788813028.317949:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788813028.317957:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cda200/0xf32533d6ff702874 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff70286d expref: 16 pid: 6486 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813028.317958:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:10357:x1875706313230080:12345-0@lo:104: Request processed in 1106us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813028.317965:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813028.317977:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875706313229568:0@lo:104: 00000100:00100000:1.0:1788813028.317984:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788813028.317999:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875706313229824:0@lo:104: 00000100:00100000:2.0:1788813028.318014:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875706313230080:0@lo:104: 00000100:00100000:0.0:1788813028.318014:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313230208 00000100:00100000:0.0:1788813028.318021:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313230208 00010000:00010000:0.0:1788813028.318041:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a821e4a00/0xf32533d6ff702820 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702819 expref: 16 pid: 6488 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813028.318054:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788813028.318073:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:3628:x1875706313229952:12345-0@lo:103: 00000100:00100000:0.0:1788813028.318079:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1788813028.318084:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788813028.318090:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:3625:x1875706313230208:12345-0@lo:103: 00010000:00010000:2.0:1788813028.318092:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a821e5a00/0xf32533d6ff7028cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff7028c8 expref: 16 pid: 6488 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.318102:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813028.318105:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a821e5a00/0xf32533d6ff7028cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff7028c8 expref: 16 pid: 6488 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.318111:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a821e4a00/0xf32533d6ff702820 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702819 expref: 16 pid: 6488 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.318130:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a821e4a00/0xf32533d6ff702820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702819 expref: 16 pid: 6488 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813028.318183:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:3627:x1875706313229696:12345-0@lo:103: Request processed in 1064us (1588us total) trans 0 rc 0/0 00010000:00010000:2.0:1788813028.318214:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e5a00/0xf32533d6ff7028cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff7028c8 expref: 16 pid: 6488 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.318219:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e4a00/0xf32533d6ff702820 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702819 expref: 16 pid: 6488 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.318227:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813028.318234:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813028.318277:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:3628:x1875706313229952:12345-0@lo:103: Request processed in 207us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813028.318281:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:3625:x1875706313230208:12345-0@lo:103: Request processed in 193us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813028.318289:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788813028.318296:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788813028.318325:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313229696:0@lo:103: 00000100:00100000:0.0:1788813028.318348:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313230208:0@lo:103: 00010000:00010000:0.0:1788813028.318369:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813028.318374:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff702786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff70278d expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.318381:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f200 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813028.318386:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff702786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff70278d expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813028.318393:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1788813028.318399:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff702786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff70278d expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813028.318408:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff702786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff70278d expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813028.318414:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788813028.318448:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff702786 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70278d expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.318455:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788813028.318464:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313229952:0@lo:103: 00010000:00010000:0.0:1788813028.318484:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff702786 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70278d expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813028.318493:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788813028.318503:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4166f200/0xf32533d6ff702786 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff70278d expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813028.318512:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313230336:0@lo:103: 00010000:00010000:0.0:1788813028.318522:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813028.318526:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813028.318528:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813028.318543:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813028.318579:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313230336 00000100:00100000:0.0:1788813028.318585:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313230336 00010000:00010000:0.0:1788813028.318601:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a821e5200/0xf32533d6ff70278d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702786 expref: 12 pid: 6486 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813028.318679:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788813028.318689:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50684c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:3625:x1875706313230336:12345-0@lo:103: 00010000:00010000:2.0:1788813028.318698:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813028.318703:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a821e5200/0xf32533d6ff70278d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702786 expref: 12 pid: 6486 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.318710:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a821e5200/0xf32533d6ff70278d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702786 expref: 12 pid: 6486 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.318720:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e5200/0xf32533d6ff70278d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702786 expref: 12 pid: 6486 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.318729:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813028.318768:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50684c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:3625:x1875706313230336:12345-0@lo:103: Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813028.318774:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788813028.318802:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313230336:0@lo:103: 00000100:00100000:3.0:1788813028.322553:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813028.322637:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301650816 00000100:00100000:0.0:1788813028.322649:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301650816 00000100:00100000:2.0:1788813028.322661:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943527b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875706313229312:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813028.322690:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f9c00/0xf32533d6ff702931 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729593 expref: 10 pid: 6486 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.322702:0:10357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948a6fc08800/0xf32533d6ff702a2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813028.322740:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 39 00000100:00100000:0.0:1788813028.322751:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:612bc516-9aee-451d-b7c0-359fff7db073+10:2396:x1875706301650816:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813028.322766:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813028.322773:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f9c00/0xf32533d6ff702931 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729593 expref: 10 pid: 6486 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.322784:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f9c00/0xf32533d6ff702931 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729593 expref: 10 pid: 6486 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.322802:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f9c00/0xf32533d6ff702931 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729593 expref: 10 pid: 6486 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.322817:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948a6fc08800/0xf32533d6ff702a2d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.322833:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc08800/0xf32533d6ff702a2d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.322848:0:9502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a6fc08800/0xf32533d6ff702a2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.322855:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a6fc08800/0xf32533d6ff702a2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.322861:0:9502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a6fc08800/0xf32533d6ff702a2d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.322868:0:9502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a6fc08800/0xf32533d6ff702a2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.322874:0:9502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08800 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813028.322877:0:9502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a6fc08800/0xf32533d6ff702a2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.322884:0:9502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a6fc08800/0xf32533d6ff702a2d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.322904:0:9502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a6fc08800/0xf32533d6ff702a2d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813028.322913:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813028.323006:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:612bc516-9aee-451d-b7c0-359fff7db073+9:2396:x1875706301650816:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 255us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813028.323014:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 39 00010000:00010000:2.0:1788813028.323026:0:10357:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948a6fc08800/0xf32533d6ff702a2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.323036:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a6fc08800/0xf32533d6ff702a2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813028.323043:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc08800/0xf32533d6ff702a2d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813028.472434:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813028.472491:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301650944 00000100:00100000:1.0:1788813028.472501:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301650944 00000100:00100000:1.0:1788813028.472543:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 199 00000100:00100000:1.0:1788813028.472553:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+9:6158:x1875706301650944:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813028.472569:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813028.472591:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8600/0xf32533d6ff702a34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a07295d9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813028.472619:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8600/0xf32533d6ff702a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07295d9 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813028.472631:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8600/0xf32533d6ff702a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07295d9 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813028.472639:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8600, rc 0) 00000100:00100000:1.0:1788813028.472692:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+10:6158:x1875706301650944:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 Request processed in 142us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813028.472697:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 199 00000100:00100000:1.0:1788813028.473644:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813028.473711:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301651072 00000100:00100000:2.0:1788813028.473717:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301651072 00000100:00100000:2.0:1788813028.473755:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 200 00000100:00100000:2.0:1788813028.473764:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:6158:x1875706301651072:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813028.473879:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:6158:x1875706301651072:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 Request processed in 116us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813028.473886:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 200 00000100:00100000:3.0:1788813028.475137:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813028.475196:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301651200 00000100:00100000:1.0:1788813028.475215:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301651200 00000100:00100000:1.0:1788813028.475252:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 201 00000100:00100000:1.0:1788813028.475262:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+10:6158:x1875706301651200:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813028.475377:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+10:6158:x1875706301651200:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 Request processed in 117us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813028.475400:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 201 00000100:00100000:3.0:1788813028.479825:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813028.479980:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301651328 00000100:00100000:2.0:1788813028.479990:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301651328 00000100:00100000:2.0:1788813028.480081:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 202 00000100:00100000:2.0:1788813028.480092:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:6679:x1875706301651328:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813028.480265:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:6679:x1875706301651328:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 174us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813028.480273:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 202 00000100:00100000:0.0:1788813028.483630:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813028.483716:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301651456 00000100:00100000:1.0:1788813028.483725:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301651456 00000100:00100000:1.0:1788813028.483774:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 203 00000100:00100000:1.0:1788813028.483791:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+10:6679:x1875706301651456:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813028.483924:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+10:6679:x1875706301651456:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 142us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813028.483971:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 203 00000100:00100000:3.0:1788813029.220127:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313230464:0@lo:13: 00000100:00100000:3.0:1788813029.220211:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.220283:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313230464 00000100:00100000:3.0:1788813029.220290:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313230464 00000100:00100000:3.0:1788813029.220340:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788813029.220349:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313230464:12345-0@lo:13: 00002000:00000024:3.0:1788813029.220376:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813029.220420:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313230464:12345-0@lo:13: Request processed in 72us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.220436:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788813029.220465:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788813029.220508:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943527b80 x1875706313230464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813029.220524:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313230464:0@lo:13: 00000100:00100000:3.0:1788813029.221016:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813029.221026:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313230592:0@lo:13: 00000100:00100000:3.0:1788813029.221054:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.221140:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313230592 00000100:00100000:2.0:1788813029.221145:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313230592 00010000:00010000:0.0:1788813029.221216:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813029.221231:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788813029.221244:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313230592:12345-0@lo:13: 00002000:00000024:2.0:1788813029.221257:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813029.221348:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313230592:12345-0@lo:13: Request processed in 105us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.221355:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788813029.221444:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813029.221493:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943526a00 x1875706313230592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813029.221506:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313230592:0@lo:13: 10000000:01000000:2.0:1788813029.860125:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788813029.860134:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a7b522000 from 48 10000000:01000000:2.0:1788813029.860140:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788813029.860207:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.860219:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.860230:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813029.860255:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313230720:0@lo:101: 00000100:00100000:2.0:1788813029.860371:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813029.860536:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313230720 00000100:00100000:1.0:1788813029.860544:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313230720 00000100:00100000:1.0:1788813029.860597:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788813029.860606:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+11:6492:x1875706313230720:12345-0@lo:101: 00010000:00010000:1.0:1788813029.860618:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813029.860637:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f9e00/0xf32533d6ff702a42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702a3b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.860660:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f9e00/0xf32533d6ff702a42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702a3b expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.860670:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f9e00/0xf32533d6ff702a42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702a3b expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.860680:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9e00, rc 0) 00000100:00100000:1.0:1788813029.860711:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6492:x1875706313230720:12345-0@lo:101: Request processed in 107us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.860717:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788813029.860786:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.860805:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313230720:0@lo:101: 00010000:00010000:2.0:1788813029.860817:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a42 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.860827:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702a42 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813029.860875:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313230848:0@lo:501: 00000100:00100000:2.0:1788813029.860906:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813029.861025:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313230848 00000100:00100000:1.0:1788813029.861034:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313230848 00000100:00100000:1.0:1788813029.861075:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788813029.861082:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6492:x1875706313230848:12345-0@lo:501: 00000100:00100000:1.0:1788813029.861216:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6492:x1875706313230848:12345-0@lo:501: Request processed in 134us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.861222:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788813029.861512:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.861528:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313230848:0@lo:501: 00000100:00100000:2.0:1788813029.861551:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313230976:0@lo:503: 00000100:00100000:2.0:1788813029.861585:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.861605:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813029.861636:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313230976 00000100:00100000:1.0:1788813029.861642:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313230976 00000100:00100000:1.0:1788813029.861671:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788813029.861678:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6492:x1875706313230976:12345-0@lo:503: 00000100:00100000:1.0:1788813029.861769:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6492:x1875706313230976:12345-0@lo:503: Request processed in 90us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.861776:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788813029.861793:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313230976:0@lo:503: 00000100:00100000:2.0:1788813029.862341:0:10474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10474:1875706313231104:0@lo:502: 00000100:00100000:2.0:1788813029.862377:0:10474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.862403:0:10474:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813029.862427:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313231104 00000100:00100000:1.0:1788813029.862432:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313231104 00000100:00100000:1.0:1788813029.862463:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788813029.862471:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:10474:x1875706313231104:12345-0@lo:502: 00000100:00100000:1.0:1788813029.862561:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:10474:x1875706313231104:12345-0@lo:502: Request processed in 90us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.862568:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788813029.862593:0:10474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10474:1875706313231104:0@lo:502: 00000100:00100000:2.0:1788813029.862628:0:10474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10474:1875706313231232:0@lo:502: 00000100:00100000:2.0:1788813029.862655:0:10474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.862670:0:10474:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813029.862694:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313231232 00000100:00100000:1.0:1788813029.862699:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313231232 00000100:00100000:1.0:1788813029.862731:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788813029.862738:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:10474:x1875706313231232:12345-0@lo:502: 00000100:00100000:1.0:1788813029.862808:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:10474:x1875706313231232:12345-0@lo:502: Request processed in 70us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.862816:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788813029.862829:0:10474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10474:1875706313231232:0@lo:502: 00000040:00080000:2.0:1788813029.862850:0:10474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788813029.862957:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788813029.862978:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788813029.862985:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a42 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.862996:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a42 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813029.863004:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788813029.863006:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788813029.863009:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788813029.863028:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.863037:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.863043:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813029.863051:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313231360:0@lo:101: 00000100:00100000:1.0:1788813029.863070:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813029.863093:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.863118:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313231360 00000100:00100000:3.0:1788813029.863124:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313231360 00000100:00100000:1.0:1788813029.863166:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788813029.863175:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+12:6492:x1875706313231360:12345-0@lo:101: 00010000:00010000:1.0:1788813029.863183:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813029.863207:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8c00/0xf32533d6ff702a50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702a49 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.863223:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8c00/0xf32533d6ff702a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702a49 expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.863239:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8c00/0xf32533d6ff702a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702a49 expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.863246:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8c00, rc 0) 00000100:00100000:1.0:1788813029.863286:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:6492:x1875706313231360:12345-0@lo:101: Request processed in 112us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.864169:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788813029.864423:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313231360:0@lo:101: 00010000:00010000:2.0:1788813029.864436:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a50 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.864442:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702a50 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813029.864480:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313231488:0@lo:501: 00000100:00100000:2.0:1788813029.864501:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.864525:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.864789:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313231488 00000100:00100000:3.0:1788813029.864793:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313231488 00000100:00100000:3.0:1788813029.864825:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788813029.864833:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:6492:x1875706313231488:12345-0@lo:501: 00000100:00100000:2.0:1788813029.865641:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313231488:0@lo:501: 00000100:00100000:3.0:1788813029.865643:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:6492:x1875706313231488:12345-0@lo:501: Request processed in 809us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.865656:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788813029.865685:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313231616:0@lo:503: 00000100:00100000:2.0:1788813029.865738:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.865765:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813029.865783:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313231616 00000100:00100000:1.0:1788813029.865787:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313231616 00000100:00100000:1.0:1788813029.865822:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788813029.865833:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:6492:x1875706313231616:12345-0@lo:503: 00000100:00100000:1.0:1788813029.865949:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:6492:x1875706313231616:12345-0@lo:503: Request processed in 105us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.865958:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788813029.866001:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313231616:0@lo:503: 00000100:00100000:0.0:1788813029.866321:0:10475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10475:1875706313231744:0@lo:502: 00000100:00100000:0.0:1788813029.866361:0:10475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813029.866391:0:10475:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6087e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.866401:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313231744 00000100:00100000:3.0:1788813029.866406:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313231744 00000100:00100000:3.0:1788813029.866435:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788813029.866441:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:10475:x1875706313231744:12345-0@lo:502: 00000100:00100000:3.0:1788813029.866513:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:10475:x1875706313231744:12345-0@lo:502: Request processed in 65us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.866520:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788813029.866544:0:10475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10475:1875706313231744:0@lo:502: 00000020:01000000:0.0:1788813029.866570:0:10475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813029.866579:0:10475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813029.866582:0:10475:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788813029.866590:0:10475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788813029.866612:0:10475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10475:1875706313231872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813029.866660:0:10475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813029.866681:0:10475:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6087e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.866779:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313231872 00000100:00100000:3.0:1788813029.866784:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313231872 00000100:00100000:3.0:1788813029.866819:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788813029.866825:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:10475:x1875706313231872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813029.866895:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:10475:x1875706313231872:12345-0@lo:502:llog_process_th.0 Request processed in 70us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.866904:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788813029.866925:0:10475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10475:1875706313231872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788813029.866979:0:10475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813029.866984:0:10475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813029.866986:0:10475:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788813029.866990:0:10475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1788813029.867057:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788813029.867084:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788813029.867093:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a50 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.867104:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a50 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813029.867113:0:6492:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813029.867115:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a7b522000 from 4 10000000:01000000:2.0:1788813029.867118:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813029.867140:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702a57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.867148:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702a57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.867156:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702a57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813029.867169:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313232000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.867207:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.867234:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813029.867281:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313232000 00000100:00100000:1.0:1788813029.867285:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313232000 00000100:00100000:1.0:1788813029.867310:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788813029.867316:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+13:6492:x1875706313232000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813029.867324:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813029.867347:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702a57 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.867366:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702a57 expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.867375:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702a57 expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.867393:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9a00, rc 0) 00000100:00100000:1.0:1788813029.867428:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:6492:x1875706313232000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.867433:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788813029.867538:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313232000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813029.867554:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702a57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a5e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.867562:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702a57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702a5e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813029.867594:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313232128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.867611:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.867629:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.867669:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313232128 00000100:00100000:3.0:1788813029.867673:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313232128 00000100:00100000:3.0:1788813029.867725:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788813029.867731:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:6492:x1875706313232128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.867798:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:6492:x1875706313232128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.867805:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788813029.867822:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313232128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.867842:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313232256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.867869:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.867883:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813029.868187:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313232256 00000100:00100000:1.0:1788813029.868203:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313232256 00000100:00100000:1.0:1788813029.868224:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788813029.868229:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:6492:x1875706313232256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813029.868289:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:6492:x1875706313232256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.868293:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788813029.868330:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313232256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813029.868637:0:10476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10476:1875706313232384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813029.868745:0:10476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813029.868778:0:10476:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6087ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.868827:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313232384 00000100:00100000:3.0:1788813029.868832:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313232384 00000100:00100000:3.0:1788813029.868865:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788813029.868872:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:10476:x1875706313232384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813029.869395:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:10476:x1875706313232384:12345-0@lo:502:llog_process_th.0 Request processed in 522us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.869403:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788813029.869625:0:10476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10476:1875706313232384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788813029.869651:0:10476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813029.869660:0:10476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813029.869668:0:10476:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788813029.869676:0:10476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a7b522000 00000020:00000080:0.0:1788813029.869678:0:10476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788813029.869761:0:10476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10476:1875706313232512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813029.869794:0:10476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813029.869871:0:10476:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a488b6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.869996:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313232512 00000100:00100000:2.0:1788813029.870001:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313232512 00000100:00100000:2.0:1788813029.870028:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788813029.870121:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:10476:x1875706313232512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813029.870255:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:10476:x1875706313232512:12345-0@lo:502:llog_process_th.0 Request processed in 133us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.870270:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788813029.870358:0:10476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10476:1875706313232512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788813029.870375:0:10476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813029.870379:0:10476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813029.870380:0:10476:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788813029.870383:0:10476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788813029.870561:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788813029.870582:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813029.870590:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702a57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a5e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.870611:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702a57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a5e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813029.870620:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788813029.870622:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a7b74e800 from 48 10000000:01000000:2.0:1788813029.870624:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788813029.870646:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.870654:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.870663:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813029.870677:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313232640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.870708:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.870738:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.870788:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313232640 00000100:00100000:3.0:1788813029.870793:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313232640 00000100:00100000:3.0:1788813029.870844:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788813029.870849:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+14:6492:x1875706313232640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813029.870855:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813029.870874:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a4151c200/0xf32533d6ff702a6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702a65 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.870900:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a4151c200/0xf32533d6ff702a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702a65 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.870909:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a4151c200/0xf32533d6ff702a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702a65 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.870916:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4151c200, rc 0) 00000100:00100000:3.0:1788813029.870974:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313232640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.870978:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788813029.871038:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313232640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813029.871047:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.871053:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702a6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813029.871093:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313232768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.871115:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.871361:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813029.871387:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313232768 00000100:00100000:0.0:1788813029.871391:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313232768 00000100:00100000:0.0:1788813029.871412:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788813029.871419:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313232768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813029.871526:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313232768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813029.871533:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788813029.871711:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313232768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.871741:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313232896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.871773:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.871791:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813029.871824:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313232896 00000100:00100000:0.0:1788813029.871828:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313232896 00000100:00100000:0.0:1788813029.871959:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788813029.871967:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313232896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813029.872056:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313232896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813029.872064:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788813029.872142:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313232896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.872283:0:10478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10478:1875706313233024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813029.872312:0:10478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.872948:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313233024 00000100:00100000:3.0:1788813029.872954:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313233024 00000100:00100000:3.0:1788813029.872978:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788813029.872984:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:10478:x1875706313233024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813029.873139:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:10478:x1875706313233024:12345-0@lo:502:llog_process_th.0 Request processed in 155us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.873145:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788813029.873333:0:10478:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.873347:0:10478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10478:1875706313233024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813029.873393:0:10478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10478:1875706313233152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813029.873423:0:10478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.873446:0:10478:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a510e7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813029.873491:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313233152 00000100:00100000:0.0:1788813029.873495:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313233152 00000100:00100000:0.0:1788813029.873530:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788813029.873543:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:10478:x1875706313233152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813029.873607:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:10478:x1875706313233152:12345-0@lo:502:llog_process_th.0 Request processed in 64us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813029.873613:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788813029.873691:0:10478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10478:1875706313233152:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788813029.873710:0:10478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788813029.873842:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788813029.873871:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788813029.873879:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813029.873889:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813029.873899:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788813029.873901:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788813029.873904:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788813029.873925:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813029.873960:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813029.873969:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813029.873983:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313233280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813029.874009:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813029.874026:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48e44c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.874082:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313233280 00000100:00100000:3.0:1788813029.874092:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313233280 00000100:00100000:3.0:1788813029.874122:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788813029.874129:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+15:6492:x1875706313233280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813029.874137:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813029.874147:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a4151ca00/0xf32533d6ff702a7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702a73 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.874166:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a4151ca00/0xf32533d6ff702a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702a73 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.874175:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a4151ca00/0xf32533d6ff702a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702a73 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.874182:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4151ca00, rc 0) 00000100:00100000:3.0:1788813029.874225:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313233280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.874230:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788813029.874260:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313233280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813029.874271:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a7a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.874281:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702a7a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813029.874324:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313233408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.874347:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.874361:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a510e73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.874372:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313233408 00000100:00100000:3.0:1788813029.874381:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313233408 00000100:00100000:3.0:1788813029.874398:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788813029.874404:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313233408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.874491:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313233408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.874498:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788813029.874526:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313233408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.874549:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313233536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.874582:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.874595:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a42b99e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.874606:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313233536 00000100:00100000:3.0:1788813029.874609:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313233536 00000100:00100000:3.0:1788813029.874625:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788813029.874630:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313233536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.874701:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313233536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.874707:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788813029.874742:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313233536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.875357:0:10479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10479:1875706313233664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813029.875392:0:10479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.875453:0:10479:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a584bdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.875482:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313233664 00000100:00100000:2.0:1788813029.875487:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313233664 00000100:00100000:2.0:1788813029.875550:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788813029.875557:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:10479:x1875706313233664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813029.875641:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:10479:x1875706313233664:12345-0@lo:502:llog_process_th.0 Request processed in 85us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.875647:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788813029.875708:0:10479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10479:1875706313233664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813029.875729:0:10479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813029.875737:0:10479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813029.875744:0:10479:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788813029.875751:0:10479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788813029.875770:0:10479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10479:1875706313233792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813029.875804:0:10479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.876021:0:10479:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a584bdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813029.876143:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313233792 00000100:00100000:0.0:1788813029.876148:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313233792 00000100:00100000:0.0:1788813029.876179:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788813029.876185:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:10479:x1875706313233792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813029.876324:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:10479:x1875706313233792:12345-0@lo:502:llog_process_th.0 Request processed in 138us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813029.876330:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788813029.876415:0:10479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10479:1875706313233792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813029.876433:0:10479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813029.876437:0:10479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813029.876439:0:10479:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788813029.876443:0:10479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1788813029.877011:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788813029.877030:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788813029.877039:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a7a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.877049:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a7a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813029.877057:0:6492:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813029.877060:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a7b74e800 from 4 10000000:01000000:2.0:1788813029.877063:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813029.877087:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08e00/0xf32533d6ff702a81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.877101:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a6fc08e00/0xf32533d6ff702a81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.877111:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a6fc08e00/0xf32533d6ff702a81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813029.877128:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313233920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.877172:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.877208:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.877224:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313233920 00000100:00100000:2.0:1788813029.877228:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313233920 00000100:00100000:2.0:1788813029.877257:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788813029.877264:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+16:6492:x1875706313233920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813029.877273:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813029.877284:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702a88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702a81 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.877305:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702a88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702a81 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.877315:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702a88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702a81 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.877323:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08200, rc 0) 00000100:00100000:2.0:1788813029.877353:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313233920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.877359:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788813029.877397:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313233920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813029.877410:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a6fc08e00/0xf32533d6ff702a81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a88 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.877418:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a6fc08e00/0xf32533d6ff702a81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702a88 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813029.877464:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313234048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.877488:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.877500:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.877512:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313234048 00000100:00100000:2.0:1788813029.877515:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313234048 00000100:00100000:2.0:1788813029.877536:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788813029.877541:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313234048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.877625:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313234048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.877631:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788813029.877657:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313234048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.877681:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313234176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.877713:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.877727:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.877737:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313234176 00000100:00100000:2.0:1788813029.877741:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313234176 00000100:00100000:2.0:1788813029.877757:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788813029.877761:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313234176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.877834:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313234176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.877847:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788813029.877885:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313234176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.878133:0:10480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10480:1875706313234304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813029.878171:0:10480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.878189:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313234304 00000100:00100000:2.0:1788813029.878204:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313234304 00000100:00100000:2.0:1788813029.878228:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788813029.878235:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:10480:x1875706313234304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813029.878320:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:10480:x1875706313234304:12345-0@lo:502:llog_process_th.0 Request processed in 85us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.878327:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788813029.878367:0:10480:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.878379:0:10480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10480:1875706313234304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788813029.878403:0:10480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813029.878411:0:10480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813029.878414:0:10480:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788813029.878420:0:10480:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a7b74e800 00000020:00000080:2.0:1788813029.878423:0:10480:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788813029.878508:0:10480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10480:1875706313234432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813029.878543:0:10480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.878563:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313234432 00000100:00100000:2.0:1788813029.878567:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313234432 00000100:00100000:2.0:1788813029.878592:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788813029.878599:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:10480:x1875706313234432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813029.878658:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:10480:x1875706313234432:12345-0@lo:502:llog_process_th.0 Request processed in 60us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.878672:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788813029.878703:0:10480:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48460840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.878715:0:10480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10480:1875706313234432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788813029.878733:0:10480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813029.878738:0:10480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813029.878739:0:10480:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788813029.878743:0:10480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788813029.878779:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788813029.878797:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813029.878804:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08e00/0xf32533d6ff702a81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a88 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.878813:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a6fc08e00/0xf32533d6ff702a81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a88 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813029.878821:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788813029.878824:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a61047800 from 48 10000000:01000000:2.0:1788813029.878826:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788813029.878847:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.878853:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.878861:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813029.878874:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313234560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.878899:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.878920:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48460840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.878955:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313234560 00000100:00100000:2.0:1788813029.878959:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313234560 00000100:00100000:2.0:1788813029.878983:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788813029.878989:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+17:6492:x1875706313234560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813029.878995:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813029.879005:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc08a00/0xf32533d6ff702a96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702a8f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.879020:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc08a00/0xf32533d6ff702a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702a8f expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.879029:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc08a00/0xf32533d6ff702a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702a8f expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.879036:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08a00, rc 0) 00000100:00100000:2.0:1788813029.879066:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313234560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.879072:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788813029.879103:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313234560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813029.879114:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.879123:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702a96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813029.879164:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313234688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.879201:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.879232:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48460840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.879244:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313234688 00000100:00100000:2.0:1788813029.879247:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313234688 00000100:00100000:2.0:1788813029.879270:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788813029.879276:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313234688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.879357:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313234688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.879363:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788813029.879401:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313234688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.879423:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313234816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.879456:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.879470:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48460840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.879482:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313234816 00000100:00100000:2.0:1788813029.879485:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313234816 00000100:00100000:2.0:1788813029.879509:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788813029.879516:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313234816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.879587:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313234816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.879594:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788813029.879632:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313234816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.879847:0:10482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10482:1875706313234944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813029.879880:0:10482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.879902:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313234944 00000100:00100000:2.0:1788813029.879906:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313234944 00000100:00100000:2.0:1788813029.879953:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788813029.879962:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:10482:x1875706313234944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813029.880045:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:10482:x1875706313234944:12345-0@lo:502:llog_process_th.0 Request processed in 84us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.880053:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788813029.880095:0:10482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48460900 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.880108:0:10482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10482:1875706313234944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813029.880148:0:10482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10482:1875706313235072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813029.880185:0:10482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.880813:0:10482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48460900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813029.880851:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313235072 00000100:00100000:0.0:1788813029.880855:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313235072 00000100:00100000:0.0:1788813029.880916:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788813029.880924:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:10482:x1875706313235072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813029.881161:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:10482:x1875706313235072:12345-0@lo:502:llog_process_th.0 Request processed in 238us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813029.881169:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788813029.881237:0:10482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10482:1875706313235072:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788813029.881260:0:10482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788813029.888314:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788813029.888354:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788813029.888366:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.888380:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813029.888389:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788813029.888392:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1788813029.888394:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788813029.888429:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.888436:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.888444:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813029.888462:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313235200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.888527:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.888603:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a584bd540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.888753:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313235200 00000100:00100000:2.0:1788813029.888761:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313235200 00000100:00100000:2.0:1788813029.888821:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788813029.888833:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+18:6492:x1875706313235200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813029.888846:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813029.888859:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc08000/0xf32533d6ff702aa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702a9d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.888883:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc08000/0xf32533d6ff702aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702a9d expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.888895:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc08000/0xf32533d6ff702aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702a9d expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.888905:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08000, rc 0) 00000100:00100000:2.0:1788813029.888975:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313235200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.888989:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788813029.889325:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313235200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813029.889339:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702aa4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.889347:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702aa4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813029.889399:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313235328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.889425:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.889483:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a584bd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788813029.889517:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313235328 00000100:00100000:0.0:1788813029.889522:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313235328 00000100:00100000:0.0:1788813029.889583:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788813029.889592:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313235328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813029.889706:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313235328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813029.889713:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788813029.889768:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313235328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.889796:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313235456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.889839:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.889919:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a584bd540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.890022:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313235456 00000100:00100000:2.0:1788813029.890027:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313235456 00000100:00100000:2.0:1788813029.890050:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788813029.890057:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313235456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.890139:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313235456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.890147:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788813029.890288:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313235456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813029.892559:0:10483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10483:1875706313235584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813029.892625:0:10483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813029.892670:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313235584 00000100:00100000:1.0:1788813029.892677:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313235584 00000100:00100000:1.0:1788813029.892716:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788813029.892723:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:10483:x1875706313235584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813029.892815:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:10483:x1875706313235584:12345-0@lo:502:llog_process_th.0 Request processed in 91us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.892822:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788813029.892868:0:10483:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256900 going to sleep for 11 seconds 00000100:00100000:1.0:1788813029.892888:0:10483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10483:1875706313235584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813029.892917:0:10483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813029.892926:0:10483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813029.892952:0:10483:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788813029.892962:0:10483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788813029.892983:0:10483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10483:1875706313235712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813029.893013:0:10483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813029.893035:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313235712 00000100:00100000:1.0:1788813029.893039:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313235712 00000100:00100000:1.0:1788813029.893060:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788813029.893068:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:10483:x1875706313235712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813029.893128:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:10483:x1875706313235712:12345-0@lo:502:llog_process_th.0 Request processed in 61us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.893135:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788813029.893164:0:10483:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256900 going to sleep for 11 seconds 00000100:00100000:1.0:1788813029.893175:0:10483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10483:1875706313235712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813029.893204:0:10483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813029.893209:0:10483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813029.893210:0:10483:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788813029.893215:0:10483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1788813029.893264:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1788813029.893281:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788813029.893290:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702aa4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.893301:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702aa4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813029.893311:0:6492:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813029.893313:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a61047800 from 4 10000000:01000000:1.0:1788813029.893316:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813029.894435:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9400/0xf32533d6ff702aab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.894457:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9400/0xf32533d6ff702aab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.894468:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9400/0xf32533d6ff702aab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813029.894486:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313235840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813029.894524:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813029.894548:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256900 going to sleep for 11 seconds 00000100:00100000:1.0:1788813029.894567:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313235840 00000100:00100000:1.0:1788813029.894572:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313235840 00000100:00100000:1.0:1788813029.894603:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788813029.894762:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:6492:x1875706313235840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813029.894774:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813029.894786:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702ab2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702aab expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.894810:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702aab expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.894820:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702aab expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.894828:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8a00, rc 0) 00000100:00100000:1.0:1788813029.894862:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313235840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 252us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.894869:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788813029.894915:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313235840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813029.894946:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9400/0xf32533d6ff702aab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702ab2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.894956:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9400/0xf32533d6ff702aab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702ab2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813029.895010:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313235968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813029.895034:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813029.895049:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256900 going to sleep for 11 seconds 00000100:00100000:1.0:1788813029.895060:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313235968 00000100:00100000:1.0:1788813029.895064:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313235968 00000100:00100000:1.0:1788813029.895086:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788813029.895093:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313235968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813029.895203:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313235968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.895210:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788813029.895242:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313235968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813029.895268:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313236096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813029.895307:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813029.895320:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256900 going to sleep for 11 seconds 00000100:00100000:1.0:1788813029.896415:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313236096 00000100:00100000:1.0:1788813029.896425:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313236096 00000100:00100000:1.0:1788813029.896466:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788813029.896474:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313236096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813029.896567:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313236096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.896580:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788813029.896771:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313236096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813029.897819:0:10485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10485:1875706313236224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813029.897872:0:10485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813029.897946:0:10485:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813029.897982:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313236224 00000100:00100000:0.0:1788813029.897988:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313236224 00000100:00100000:0.0:1788813029.898025:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788813029.898033:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:10485:x1875706313236224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813029.898138:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:10485:x1875706313236224:12345-0@lo:502:llog_process_th.0 Request processed in 106us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813029.898146:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788813029.898428:0:10485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10485:1875706313236224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813029.898455:0:10485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813029.898465:0:10485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813029.898467:0:10485:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788813029.898478:0:10485:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a61047800 00000020:00000080:1.0:1788813029.898481:0:10485:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788813029.898833:0:10485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10485:1875706313236352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813029.898871:0:10485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813029.898905:0:10485:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe76600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.898981:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313236352 00000100:00100000:2.0:1788813029.898987:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313236352 00000100:00100000:2.0:1788813029.899018:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788813029.899026:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:10485:x1875706313236352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813029.899100:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:10485:x1875706313236352:12345-0@lo:502:llog_process_th.0 Request processed in 74us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.899106:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788813029.899484:0:10485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10485:1875706313236352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813029.899511:0:10485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813029.899517:0:10485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813029.899519:0:10485:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788813029.899525:0:10485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788813029.899754:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788813029.899775:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813029.899783:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9400/0xf32533d6ff702aab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702ab2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.899794:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9400/0xf32533d6ff702aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702ab2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813029.899803:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788813029.899806:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a60186000 from 48 10000000:01000000:2.0:1788813029.899809:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788813029.899833:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.899846:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.899856:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813029.899871:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313236480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.899902:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.899928:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a484603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813029.900015:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313236480 00000100:00100000:0.0:1788813029.900020:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313236480 00000100:00100000:0.0:1788813029.900046:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788813029.900054:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313236480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813029.900063:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813029.900074:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cdba00/0xf32533d6ff702ac0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702ab9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813029.900095:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdba00/0xf32533d6ff702ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702ab9 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813029.900106:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cdba00/0xf32533d6ff702ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702ab9 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813029.900114:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdba00, rc 0) 00000100:00100000:0.0:1788813029.900144:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313236480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813029.900150:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788813029.900285:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313236480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813029.900297:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.900306:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813029.900352:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313236608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.900376:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.900405:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a484603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813029.900457:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313236608 00000100:00100000:0.0:1788813029.900461:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313236608 00000100:00100000:0.0:1788813029.900493:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788813029.900500:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313236608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813029.900592:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313236608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813029.900599:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788813029.900665:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313236608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.900690:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313236736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.900724:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813029.900746:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a484603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.900758:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313236736 00000100:00100000:2.0:1788813029.900762:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313236736 00000100:00100000:2.0:1788813029.900799:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788813029.900805:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313236736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813029.900870:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313236736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.900875:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788813029.900916:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313236736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813029.901423:0:10486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10486:1875706313236864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813029.901463:0:10486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813029.901505:0:10486:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe76600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813029.901576:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313236864 00000100:00100000:2.0:1788813029.901581:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313236864 00000100:00100000:2.0:1788813029.901608:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788813029.901615:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:10486:x1875706313236864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813029.901689:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:10486:x1875706313236864:12345-0@lo:502:llog_process_th.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.901696:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788813029.902286:0:10486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10486:1875706313236864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813029.902335:0:10486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10486:1875706313236992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813029.902369:0:10486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.902398:0:10486:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a584bd540 going to sleep for 11 seconds 00000100:00100000:1.0:1788813029.902553:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313236992 00000100:00100000:1.0:1788813029.902559:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313236992 00000100:00100000:1.0:1788813029.902600:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788813029.902609:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:10486:x1875706313236992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813029.902761:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:10486:x1875706313236992:12345-0@lo:502:llog_process_th.0 Request processed in 152us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.902767:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788813029.903154:0:10486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10486:1875706313236992:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788813029.903178:0:10486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788813029.903271:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788813029.903295:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788813029.903304:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.903315:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813029.903324:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788813029.903328:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1788813029.903331:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788813029.903355:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.903363:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.903372:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813029.903387:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313237120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813029.903420:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813029.903445:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788813029.903458:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313237120 00000100:00100000:1.0:1788813029.903462:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313237120 00000100:00100000:1.0:1788813029.903497:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788813029.903513:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313237120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813029.903522:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813029.903532:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f9800/0xf32533d6ff702ace lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702ac7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.903550:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f9800/0xf32533d6ff702ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702ac7 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.903561:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f9800/0xf32533d6ff702ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702ac7 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.903569:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9800, rc 0) 00000100:00100000:1.0:1788813029.903606:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313237120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.903613:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788813029.903696:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313237120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813029.903708:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702ace expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813029.903727:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702ace expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813029.903777:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313237248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813029.903802:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813029.903829:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813029.903882:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313237248 00000100:00100000:1.0:1788813029.903898:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313237248 00000100:00100000:1.0:1788813029.903929:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788813029.903961:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313237248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813029.904067:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313237248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.904074:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788813029.904091:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313237248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813029.904118:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313237376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813029.904228:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813029.904258:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.904330:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313237376 00000100:00100000:3.0:1788813029.904340:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313237376 00000100:00100000:3.0:1788813029.904369:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788813029.904376:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313237376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.904452:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313237376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.904460:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788813029.904476:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313237376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.904922:0:10487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10487:1875706313237504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813029.905082:0:10487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.905104:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313237504 00000100:00100000:3.0:1788813029.905109:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313237504 00000100:00100000:3.0:1788813029.905131:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788813029.905137:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:10487:x1875706313237504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813029.905224:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:10487:x1875706313237504:12345-0@lo:502:llog_process_th.0 Request processed in 86us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.905230:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788813029.905267:0:10487:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a584bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.905285:0:10487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10487:1875706313237504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813029.905306:0:10487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813029.905313:0:10487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813029.905315:0:10487:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788813029.905322:0:10487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788813029.905340:0:10487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10487:1875706313237632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813029.905369:0:10487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.905387:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313237632 00000100:00100000:3.0:1788813029.905391:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313237632 00000100:00100000:3.0:1788813029.905411:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788813029.905416:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:10487:x1875706313237632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813029.905478:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:10487:x1875706313237632:12345-0@lo:502:llog_process_th.0 Request processed in 60us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.905485:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788813029.905517:0:10487:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a584bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.905530:0:10487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10487:1875706313237632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813029.905546:0:10487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813029.905550:0:10487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813029.905552:0:10487:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788813029.905556:0:10487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788813029.905597:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1788813029.905613:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788813029.905620:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702ace expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.905629:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702ace expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813029.905638:0:6492:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788813029.905640:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a60186000 from 4 10000000:01000000:3.0:1788813029.905642:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788813029.905661:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff702ad5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.905669:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff702ad5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.905678:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff702ad5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813029.905690:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313237760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.905721:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.905735:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a584bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.905747:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313237760 00000100:00100000:3.0:1788813029.905750:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313237760 00000100:00100000:3.0:1788813029.905772:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788813029.905779:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313237760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813029.905787:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813029.905799:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a4151da00/0xf32533d6ff702adc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702ad5 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.905816:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a4151da00/0xf32533d6ff702adc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702ad5 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.905826:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a4151da00/0xf32533d6ff702adc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702ad5 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.905834:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4151da00, rc 0) 00000100:00100000:3.0:1788813029.905866:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313237760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.905872:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788813029.905901:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313237760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813029.905913:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff702ad5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702adc expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.905922:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff702ad5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702adc expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813029.905983:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313237888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.906016:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.906041:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a584bdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813029.906046:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313237888 00000100:00100000:0.0:1788813029.906050:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313237888 00000100:00100000:0.0:1788813029.906073:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788813029.906079:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313237888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813029.906179:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313237888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813029.906186:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788813029.908281:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313237888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.908340:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313238016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.908417:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813029.908448:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a584bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.908465:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313238016 00000100:00100000:3.0:1788813029.908470:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313238016 00000100:00100000:3.0:1788813029.908527:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788813029.908538:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313238016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.908666:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313238016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.908673:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788813029.908706:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313238016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813029.909037:0:10489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943532680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10489:1875706313238144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813029.909073:0:10489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813029.909100:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313238144 00000100:00100000:0.0:1788813029.909103:0:10489:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788813029.909106:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313238144 00000100:00100000:1.0:1788813029.909224:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788813029.909234:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:10489:x1875706313238144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813029.909328:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:10489:x1875706313238144:12345-0@lo:502:llog_process_th.0 Request processed in 96us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.909336:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788813029.909399:0:10489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943532680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10489:1875706313238144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788813029.909425:0:10489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813029.909440:0:10489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813029.909443:0:10489:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788813029.909453:0:10489:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a60186000 00000020:00000080:0.0:1788813029.909457:0:10489:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788813029.909526:0:10489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943532680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10489:1875706313238272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813029.909566:0:10489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813029.909589:0:10489:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788813029.909590:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313238272 00000100:00100000:3.0:1788813029.909597:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313238272 00000100:00100000:3.0:1788813029.909631:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788813029.909639:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:10489:x1875706313238272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813029.909709:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:10489:x1875706313238272:12345-0@lo:502:llog_process_th.0 Request processed in 71us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.909716:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788813029.909991:0:10489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943532680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:10489:1875706313238272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813029.910011:0:10489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813029.910017:0:10489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813029.910018:0:10489:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788813029.910026:0:10489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788813029.910086:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788813029.910111:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788813029.910121:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff702ad5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702adc expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.910132:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff702ad5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702adc expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813029.910149:0:6492:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788813029.910152:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff948a506e4d40 from 1 10000000:01000000:3.0:1788813029.910154:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788813029.910179:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff702ae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.910188:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff702ae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.910209:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff702ae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813029.910224:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313238400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813029.910252:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813029.910276:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313238400 00000100:00100000:0.0:1788813029.910282:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313238400 00000100:00100000:3.0:1788813029.910288:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a510e73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813029.910313:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788813029.910321:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313238400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813029.910329:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813029.910342:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cda200/0xf32533d6ff702aea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702ae3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813029.910363:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cda200/0xf32533d6ff702aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702ae3 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813029.910374:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cda200/0xf32533d6ff702aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702ae3 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813029.910380:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cda200, rc 0) 00000100:00100000:0.0:1788813029.910404:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313238400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813029.910410:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788813029.910445:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313238400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813029.910458:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff702ae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702aea expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813029.910480:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff702ae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702aea expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813029.910531:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313238528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813029.910560:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813029.910573:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813029.910582:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313238528 00000100:00100000:0.0:1788813029.910584:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313238528 00000100:00100000:0.0:1788813029.910606:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788813029.910612:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313238528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813029.910677:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313238528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (116us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813029.910685:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788813029.910715:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313238528:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788813029.910735:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788813029.910740:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff702ae3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702aea expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813029.910748:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff702ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702aea expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813030.244148:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813030.244175:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313238656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813030.244279:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813030.244402:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313238656 00000100:00100000:3.0:1788813030.244413:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313238656 00000100:00100000:3.0:1788813030.244479:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813030.244492:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313238656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788813030.244538:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788813030.244592:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313238656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813030.244597:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813030.244643:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313238656:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788813030.248148:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813030.756261:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313238784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813030.756356:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813030.756407:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313238784 00000100:00100000:0.0:1788813030.756417:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313238784 00000100:00100000:0.0:1788813030.756521:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788813030.756532:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313238784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788813030.756577:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788813030.756638:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313238784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813030.756645:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788813030.756790:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313238784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813031.269140:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313238912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813031.269211:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813031.269281:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313238912 00000100:00100000:3.0:1788813031.269289:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313238912 00000100:00100000:3.0:1788813031.269335:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788813031.269343:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313238912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813031.269371:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813031.269404:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313239168:0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.269406:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313238912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813031.269412:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813031.269432:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788813031.269433:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813031.269446:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313239168 00000100:00100000:3.0:1788813031.269449:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313239168 00000100:00100000:0.0:1788813031.269451:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313239680:0@lo:400:kworker.0 00000100:00100000:0.0:1788813031.269469:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813031.269475:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313239680 00000100:00100000:3.0:1788813031.269477:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313239680 00000100:00100000:0.0:1788813031.269482:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313240192:0@lo:400:kworker.0 00000100:00100000:0.0:1788813031.269501:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813031.269525:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788813031.269530:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313239296:0@lo:400:kworker.0 00000100:00100000:0.0:1788813031.269553:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813031.269570:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313239808:0@lo:400:kworker.0 00000100:00100000:0.0:1788813031.269589:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813031.269599:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313240320:0@lo:400:kworker.0 00000100:00100000:0.0:1788813031.269618:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813031.269622:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313240192 00000100:00100000:3.0:1788813031.269626:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313240192 00010000:00010000:0.0:1788813031.269639:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813031.269641:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313239808 00000100:00100000:3.0:1788813031.269643:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313239808 00000100:00100000:0.0:1788813031.269648:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313240320 00000100:00100000:0.0:1788813031.269650:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313240320 00000100:00100000:3.0:1788813031.269655:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788813031.269661:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313239168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813031.269667:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788813031.269672:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313239680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.269740:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313239168:12345-0@lo:400:kworker.0 Request processed in 78us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813031.269746:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788813031.269760:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788813031.269765:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313240192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.270112:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313240192:12345-0@lo:400:kworker.0 Request processed in 347us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813031.270125:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788813031.270137:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788813031.270142:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313239808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.270172:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313239808:12345-0@lo:400:kworker.0 Request processed in 30us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813031.270189:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788813031.270204:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788813031.270211:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313240320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813031.270231:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313239680:12345-0@lo:400:kworker.0 Request processed in 557us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813031.270235:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313240320:12345-0@lo:400:kworker.0 Request processed in 25us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813031.270240:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813031.270243:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788813031.270262:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313239296 00000100:00100000:3.0:1788813031.270263:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313239040:0@lo:400:kworker.0 00000100:00100000:0.0:1788813031.270266:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313239296 00000100:00100000:0.0:1788813031.270289:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788813031.270290:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813031.270295:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313239296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.270312:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313239552:0@lo:400:kworker.0 00000100:00100000:0.0:1788813031.270326:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313239296:12345-0@lo:400:kworker.0 Request processed in 31us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813031.270329:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813031.270332:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788813031.270341:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313239552 00000100:00100000:3.0:1788813031.270344:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313240064:0@lo:400:kworker.0 00000100:00100000:0.0:1788813031.270344:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313239552 00000100:00100000:0.0:1788813031.270357:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788813031.270361:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313239552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.270365:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813031.270382:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313240576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813031.270385:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313239552:12345-0@lo:400:kworker.0 Request processed in 23us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813031.270390:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788813031.270400:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813031.270413:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313240576 00000100:00100000:0.0:1788813031.270416:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313240576 00000100:00100000:3.0:1788813031.270430:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313239552:0@lo:400:kworker.0 00000100:00100000:0.0:1788813031.270435:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813031.270439:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313240576:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813031.270444:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00002000:00000024:0.0:1788813031.270449:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813031.270450:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313239424:0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.270470:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813031.270472:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313240576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813031.270478:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788813031.270562:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313239936:0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.270584:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813031.270608:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313240448:0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.270624:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788813031.270645:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489434e5180 x1875706313240576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813031.270659:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313240576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813031.270680:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313239040 00000100:00100000:3.0:1788813031.270682:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313239040 00000100:00100000:3.0:1788813031.270702:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788813031.270707:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3628:x1875706313239040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.270733:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3628:x1875706313239040:12345-0@lo:400:kworker.0 Request processed in 26us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813031.270738:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788813031.270760:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313240064 00000100:00100000:3.0:1788813031.270763:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313240064 00000100:00100000:3.0:1788813031.270781:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313239936 00000100:00100000:3.0:1788813031.270783:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313239936 00000100:00100000:3.0:1788813031.270791:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313240448 00000100:00100000:3.0:1788813031.270793:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313240448 00000100:00100000:3.0:1788813031.270801:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813031.270805:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313240064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.270827:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313240064:12345-0@lo:400:kworker.0 Request processed in 21us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813031.270832:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813031.270840:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788813031.270845:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313239936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.270879:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313239936:12345-0@lo:400:kworker.0 Request processed in 34us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813031.270885:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788813031.270896:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813031.270901:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313240448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.270925:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313240448:12345-0@lo:400:kworker.0 Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813031.270949:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788813031.270970:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813031.270973:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813031.270976:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813031.270977:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788813031.270995:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7fd91f80 x1875706313238912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813031.271003:0:3627:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788813031.271016:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313238912:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788813031.271041:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943531c00 x1875706313239936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813031.271049:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313239936:0@lo:400:kworker.0 00010000:00080000:3.0:1788813031.271058:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943531180 x1875706313240448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813031.271066:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313240448:0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.271074:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313239040:0@lo:400:kworker.0 00010000:00080000:3.0:1788813031.271083:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943532a00 x1875706313240064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813031.271097:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313240064:0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.271116:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313239424 00000100:00100000:3.0:1788813031.271119:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313239424 00000100:00100000:3.0:1788813031.271139:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813031.271146:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313239424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813031.271189:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313239424:12345-0@lo:400:kworker.0 Request processed in 33us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813031.271194:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813031.271218:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313239424:0@lo:400:kworker.0 00000100:00100000:1.0:1788813031.271638:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313239168:0@lo:400:kworker.0 00000100:00100000:1.0:1788813031.271651:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313239680:0@lo:400:kworker.0 00000100:00100000:1.0:1788813031.271662:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313240192:0@lo:400:kworker.0 00000100:00100000:1.0:1788813031.271680:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313239296:0@lo:400:kworker.0 00010000:00080000:1.0:1788813031.271691:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943530000 x1875706313239808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813031.271699:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313239808:0@lo:400:kworker.0 00010000:00080000:1.0:1788813031.271708:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943530380 x1875706313240320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813031.271717:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313240320:0@lo:400:kworker.0 00000100:00100000:0.0:1788813031.296754:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813031.296800:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813031.296826:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813031.296859:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813031.296883:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813031.296911:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301651968 00000100:00100000:0.0:1788813031.296920:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301651968 00000100:00100000:0.0:1788813031.297000:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301652096 00000100:00100000:0.0:1788813031.297004:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301652096 00000100:00100000:0.0:1788813031.297030:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:0.0:1788813031.297040:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301651968:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813031.297108:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301651968:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 69us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813031.297115:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:0.0:1788813031.297134:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:0.0:1788813031.297141:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301652096:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813031.297165:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301652096:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813031.297171:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:0.0:1788813031.297212:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301651712 00000100:00100000:0.0:1788813031.297216:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301651712 00000100:00100000:0.0:1788813031.297246:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301651840 00000100:00100000:0.0:1788813031.297249:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301651840 00000100:00100000:0.0:1788813031.297271:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 45 00000100:00100000:0.0:1788813031.297277:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2396:x1875706301651712:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813031.297308:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2396:x1875706301651712:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813031.297314:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301651584 00000100:00100000:0.0:1788813031.297316:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 45 00000100:00100000:3.0:1788813031.297323:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301651584 00000100:00100000:0.0:1788813031.297335:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00100000:0.0:1788813031.297352:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301651840:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813031.297368:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 267 00000100:00100000:3.0:1788813031.297379:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+10:2397:x1875706301651584:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813031.297382:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301651840:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 30us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813031.297390:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00080000:0.0:1788813031.297415:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788813031.297417:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+10:2397:x1875706301651584:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 39us (615us total) trans 0 rc 0/0 00000100:00080000:0.0:1788813031.297420:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813031.297424:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813031.297428:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813031.297436:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 267 00000001:02000400:0.0:1788813031.448086:0:10665:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788813032.292185:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813033.317210:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788813034.103816:0:10908:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing yml_node 00000100:00100000:0.0:1788813034.340436:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813034.340458:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313240704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813034.340534:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813034.340633:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313240704 00000100:00100000:1.0:1788813034.340641:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313240704 00000100:00100000:1.0:1788813034.340700:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788813034.340711:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313240704:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788813034.340742:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788813034.340746:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813034.340794:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313240704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813034.340802:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788813034.340818:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76414700 x1875706313240704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813034.340838:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313240704:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788813034.341357:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813034.341751:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313240832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813034.341790:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813034.344081:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313240832 00000100:00100000:1.0:1788813034.344094:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313240832 00000100:00080000:1.0:1788813034.344269:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813034.344299:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788813034.344312:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313240832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813034.344340:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813034.344424:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313240832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813034.344432:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788813034.344663:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943526d80 x1875706313240832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813034.344679:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313240832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813035.364201:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813035.364225:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313240960:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788813035.364283:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813035.364317:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813035.364956:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313240960 00000100:00100000:0.0:1788813035.364962:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313240960 00000100:00100000:0.0:1788813035.365022:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788813035.365031:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313240960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813035.365064:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788813035.365135:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313240960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813035.365154:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788813035.365210:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313240960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813035.876152:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313241088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813035.876223:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813035.876256:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313241088 00000100:00100000:2.0:1788813035.876265:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313241088 00000100:00100000:2.0:1788813035.876318:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788813035.876329:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313241088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788813035.876369:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788813035.878925:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313241088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2590us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813035.878949:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788813035.878949:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313241088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813036.388087:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813036.388107:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313241216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813036.388178:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813036.388242:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313241216 00000100:00100000:3.0:1788813036.388250:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313241216 00000100:00100000:3.0:1788813036.388298:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788813036.388306:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313241216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813036.388332:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813036.388379:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313241216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813036.388386:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788813036.388406:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788813036.388433:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76414000 x1875706313241216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813036.388450:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313241216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813036.388611:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813036.388621:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313241344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813036.388649:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813036.388715:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313241344 00000100:00100000:1.0:1788813036.388720:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313241344 00000100:00100000:1.0:1788813036.388755:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788813036.388761:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313241344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788813036.388772:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813036.388800:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313241344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813036.388806:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788813036.388896:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788813036.388916:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489434e7100 x1875706313241344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813036.388929:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313241344:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788813036.391032:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813036.393193:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313241472:0@lo:400:kworker.0 00000100:00100000:2.0:1788813036.393271:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813036.395279:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313241984:0@lo:400:kworker.0 00000100:00100000:2.0:1788813036.395336:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813036.395372:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313242496:0@lo:400:kworker.0 00000100:00100000:2.0:1788813036.395397:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813036.395434:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788813036.395441:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313241600:0@lo:400:kworker.0 00000100:00100000:2.0:1788813036.395467:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813036.395488:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313242112:0@lo:400:kworker.0 00000100:00100000:0.0:1788813036.395504:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313241600 00000100:00100000:2.0:1788813036.395510:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813036.395513:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313241600 00000100:00100000:2.0:1788813036.395532:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313242624:0@lo:400:kworker.0 00000100:00100000:2.0:1788813036.395558:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813036.395562:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313242112 00000100:00100000:0.0:1788813036.395566:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313242112 00000100:00100000:0.0:1788813036.395595:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313242624 00000100:00100000:0.0:1788813036.395597:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313242624 00000100:00100000:2.0:1788813036.395606:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313241472 00000100:00100000:2.0:1788813036.395613:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313241472 00000100:00100000:0.0:1788813036.395620:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788813036.395631:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313241600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813036.395643:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788813036.395652:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313241472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813036.395700:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313241600:12345-0@lo:400:kworker.0 Request processed in 71us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813036.395703:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313241472:12345-0@lo:400:kworker.0 Request processed in 51us (2430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813036.395713:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788813036.395717:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788813036.395736:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788813036.395745:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313242112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813036.395756:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313241984 00000100:00100000:2.0:1788813036.395761:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313241984 00000100:00100000:0.0:1788813036.395775:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313242112:12345-0@lo:400:kworker.0 Request processed in 31us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813036.395781:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788813036.395791:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813036.395800:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788813036.395809:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313242624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813036.395815:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313241984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813036.395832:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313242624:12345-0@lo:400:kworker.0 Request processed in 25us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813036.395839:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788813036.395865:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813036.395872:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313241984:12345-0@lo:400:kworker.0 Request processed in 73us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813036.395880:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813036.395896:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313241600:0@lo:400:kworker.0 00000100:00100000:2.0:1788813036.395902:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313242496 00000100:00100000:2.0:1788813036.395907:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313242496 00000100:00100000:0.0:1788813036.395912:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313242112:0@lo:400:kworker.0 00000100:00100000:0.0:1788813036.395957:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313242624:0@lo:400:kworker.0 00000100:00100000:2.0:1788813036.395964:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788813036.395971:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313241984:0@lo:400:kworker.0 00000100:00100000:2.0:1788813036.395981:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313242496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813036.395982:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313241472:0@lo:400:kworker.0 00000100:00100000:2.0:1788813036.396015:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313242496:12345-0@lo:400:kworker.0 Request processed in 45us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813036.396020:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788813036.396027:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccbea00 x1875706313242496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813036.396038:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313242496:0@lo:400:kworker.0 00000100:00080000:0.0:1788813036.396064:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813036.396495:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313241728:0@lo:400:kworker.0 00000100:00100000:3.0:1788813036.396520:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813036.396542:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313242240:0@lo:400:kworker.0 00000100:00100000:3.0:1788813036.396557:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813036.396567:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313241728 00000100:00100000:2.0:1788813036.396573:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313241728 00000100:00100000:3.0:1788813036.396574:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313242752:0@lo:400:kworker.0 00000100:00100000:3.0:1788813036.396596:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813036.396611:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788813036.396616:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788813036.396617:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313241856:0@lo:400:kworker.0 00000100:00100000:2.0:1788813036.396630:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313241728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813036.396647:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813036.396667:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313242368:0@lo:400:kworker.0 00000100:00100000:2.0:1788813036.396675:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313241728:12345-0@lo:400:kworker.0 Request processed in 48us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813036.396692:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788813036.396697:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813036.396724:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313241728:0@lo:400:kworker.0 00000100:00100000:0.0:1788813036.396754:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313242368 00000100:00100000:0.0:1788813036.396759:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313242368 00000100:00100000:0.0:1788813036.396805:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813036.396811:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313242368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813036.396851:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313242368:12345-0@lo:400:kworker.0 Request processed in 40us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813036.396856:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813036.396873:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313242240 00000100:00100000:0.0:1788813036.396877:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313242240 00000100:00100000:0.0:1788813036.396898:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313242752 00000100:00100000:0.0:1788813036.396901:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313242752 00000100:00100000:0.0:1788813036.396913:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313241856 00000100:00100000:0.0:1788813036.396915:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313241856 00000100:00100000:0.0:1788813036.396927:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813036.396957:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313242240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813036.396986:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313242240:12345-0@lo:400:kworker.0 Request processed in 31us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813036.396992:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813036.397012:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788813036.397018:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313242752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813036.397049:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313242752:12345-0@lo:400:kworker.0 Request processed in 32us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813036.397054:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788813036.397065:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788813036.397071:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313241856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813036.397098:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313241856:12345-0@lo:400:kworker.0 Request processed in 27us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813036.397103:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788813036.397154:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313241856:0@lo:400:kworker.0 00000100:00080000:2.0:1788813036.397297:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788813036.397302:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813036.397399:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccbd880 x1875706313242368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813036.397411:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313242368:0@lo:400:kworker.0 00010000:00080000:0.0:1788813036.397430:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7fd91f80 x1875706313242240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813036.397438:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313242240:0@lo:400:kworker.0 00010000:00080000:0.0:1788813036.397456:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccbca80 x1875706313242752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813036.397465:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313242752:0@lo:400:kworker.0 00000100:00100000:3.0:1788813036.415875:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813036.415918:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813036.415957:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813036.415975:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301652224 00000100:00100000:0.0:1788813036.415984:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301652224 00000100:00100000:3.0:1788813036.415994:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813036.416016:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813036.416028:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 269 00000100:00100000:3.0:1788813036.416034:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301652608 00000100:00100000:0.0:1788813036.416037:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+10:2398:x1875706301652224:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813036.416043:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301652608 00000100:00100000:3.0:1788813036.416075:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301652736 00000100:00100000:3.0:1788813036.416078:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301652736 00000100:00100000:3.0:1788813036.416095:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00100000:3.0:1788813036.416102:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301652608:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813036.416102:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+10:2398:x1875706301652224:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 68us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813036.416110:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 269 00000100:00100000:3.0:1788813036.416127:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301652608:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813036.416144:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00100000:3.0:1788813036.416157:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:3.0:1788813036.416163:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301652736:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813036.416184:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301652736:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 22us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813036.416189:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00080000:3.0:1788813036.416206:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813036.416210:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813036.416261:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301652352 00000100:00100000:0.0:1788813036.416265:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301652352 00000100:00080000:3.0:1788813036.416302:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813036.416303:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301652480 00000100:00100000:0.0:1788813036.416306:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301652480 00000100:00100000:0.0:1788813036.416333:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 53 00000100:00100000:0.0:1788813036.416339:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2399:x1875706301652352:12345-192.168.202.13@tcp:400:kworker.0 00000100:00080000:3.0:1788813036.416354:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813036.416381:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2399:x1875706301652352:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 41us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813036.416387:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 53 00000100:00100000:0.0:1788813036.416401:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 54 00000100:00100000:0.0:1788813036.416407:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301652480:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813036.416431:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301652480:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813036.416437:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 54 00000001:02000400:3.0:1788813036.571700:0:11092:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.41 00010000:00010000:0.0:1788813037.415704:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788813037.851198:0:11189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.41 00010000:00010000:0.0:1788813038.436036:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788813039.157899:0:11286:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.41 00000100:00100000:1.0:1788813039.460439:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813039.461776:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313243008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813039.461890:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813039.462025:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813039.462050:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313243008 00000100:00100000:3.0:1788813039.462059:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313243008 00000100:00080000:0.0:1788813039.462116:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813039.462130:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788813039.462142:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313243008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788813039.462170:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813039.463401:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313242880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813039.463442:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813039.463486:0:8407:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788813039.463495:0:8407:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788813039.463658:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313242880 00000100:00100000:0.0:1788813039.463663:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313242880 00000100:00080000:0.0:1788813039.463695:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813039.463785:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788813039.463794:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313242880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813039.463815:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813039.463896:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313242880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813039.463904:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788813039.464032:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943525880 x1875706313242880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813039.464053:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313242880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813039.464350:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313243008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2210us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813039.464359:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788813039.465318:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e04a80 x1875706313243008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813039.465338:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313243008:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1788813039.904836:0:11335:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 16:30:39 EDT 2026 00010000:00010000:0.0:1788813040.484067:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813040.485205:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813040.485238:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313243136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813040.485356:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813040.485464:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313243136 00000100:00100000:3.0:1788813040.485482:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313243136 00000100:00100000:3.0:1788813040.485544:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788813040.485554:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313243136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788813040.485615:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788813040.485679:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313243136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813040.485687:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788813040.485720:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313243136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813040.999364:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313243264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813040.999438:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813040.999703:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313243264 00000100:00100000:0.0:1788813040.999712:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313243264 00000100:00100000:0.0:1788813040.999768:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813040.999778:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313243264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788813040.999846:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788813040.999901:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313243264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813040.999908:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788813041.000037:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313243264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813041.508255:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313243520:0@lo:400:kworker.0 00000100:00100000:1.0:1788813041.508326:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313243904:0@lo:400:kworker.0 00000100:00100000:1.0:1788813041.508402:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.508411:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.508470:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313243392:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788813041.508567:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813041.509020:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.509110:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313244032:0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.509163:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.509187:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313244544:0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.509225:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.509253:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313243776:0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.509272:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.509285:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313244288:0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.509305:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.509317:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313244800:0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.509330:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.509341:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788813041.509344:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313243648:0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.509355:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.509365:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313244160:0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.509389:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.509401:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313244672:0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.509420:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.509448:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313243904 00000100:00100000:3.0:1788813041.509456:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313243904 00000100:00100000:3.0:1788813041.509509:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788813041.509520:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313243904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813041.509572:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313244416:0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.509575:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313243904:12345-0@lo:400:kworker.0 Request processed in 58us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.509591:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788813041.509618:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313243520 00000100:00100000:3.0:1788813041.509623:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313243520 00000100:00100000:1.0:1788813041.509632:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813041.509665:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313244928:0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.509668:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788813041.509688:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313243520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813041.509732:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.509742:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313243520:12345-0@lo:400:kworker.0 Request processed in 58us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.509750:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788813041.509795:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313243392 00000100:00100000:3.0:1788813041.509801:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313243392 00000100:00100000:1.0:1788813041.509819:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313243904:0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.509857:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788813041.509868:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313243392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813041.509897:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813041.509927:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313244288 00000100:00100000:1.0:1788813041.509961:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313244288 00000100:00100000:3.0:1788813041.509986:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313243392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.509995:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813041.510019:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313244800 00000100:00100000:1.0:1788813041.510026:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313244800 00000100:00100000:3.0:1788813041.510034:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313244032 00000100:00100000:3.0:1788813041.510048:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313244032 00000100:00100000:1.0:1788813041.510050:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313244416 00000100:00100000:1.0:1788813041.510066:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313244416 00000100:00100000:3.0:1788813041.510093:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313244544 00000100:00100000:3.0:1788813041.510099:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313244544 00000100:00100000:1.0:1788813041.510117:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313244928 00000100:00100000:1.0:1788813041.510123:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313244928 00000100:00100000:3.0:1788813041.510131:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313243776 00000100:00100000:3.0:1788813041.510137:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313243776 00000100:00100000:1.0:1788813041.510153:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788813041.510167:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313244288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.510169:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313243648 00000100:00100000:3.0:1788813041.510178:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313243648 00000100:00100000:3.0:1788813041.510207:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313244160 00000100:00100000:3.0:1788813041.510210:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313244160 00000100:00100000:3.0:1788813041.510239:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313244672 00000100:00100000:3.0:1788813041.510243:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313244672 00000100:00100000:1.0:1788813041.510259:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313244288:12345-0@lo:400:kworker.0 Request processed in 96us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813041.510273:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788813041.510274:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788813041.510293:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313244032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813041.510307:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788813041.510319:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313244800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.510353:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313244032:12345-0@lo:400:kworker.0 Request processed in 62us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.510366:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788813041.510385:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313244800:12345-0@lo:400:kworker.0 Request processed in 65us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.510392:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788813041.510414:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313244544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813041.510414:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788813041.510453:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788813041.510474:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313244416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.510475:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313244544:12345-0@lo:400:kworker.0 Request processed in 61us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.510488:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788813041.510499:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788813041.510503:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313243776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.510520:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313243776:12345-0@lo:400:kworker.0 Request processed in 17us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.510525:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788813041.510531:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788813041.510534:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313243648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.510573:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313243648:12345-0@lo:400:kworker.0 Request processed in 36us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.510579:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788813041.510592:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788813041.510599:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313244160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.510629:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313244160:12345-0@lo:400:kworker.0 Request processed in 32us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.510634:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788813041.510646:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788813041.510651:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313244672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.510676:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313244672:12345-0@lo:400:kworker.0 Request processed in 26us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.510680:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788813041.510704:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788813041.510709:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313244928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.510728:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313244928:12345-0@lo:400:kworker.0 Request processed in 20us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.510732:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788813041.510756:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813041.510758:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813041.510761:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813041.510764:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813041.510786:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313245056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813041.510808:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.510850:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313244032:0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.510878:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313244544:0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.510888:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313243520:0@lo:400:kworker.0 00010000:00080000:3.0:1788813041.510903:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e06300 x1875706313243392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813041.510920:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313243392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813041.510975:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313245056 00000100:00100000:3.0:1788813041.510978:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313245056 00000100:00100000:3.0:1788813041.511002:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788813041.511008:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313245056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788813041.511016:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813041.511041:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313245056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.511046:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788813041.511072:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943642300 x1875706313245056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813041.511100:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313245056:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788813041.511177:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489434e6a00 x1875706313244928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813041.511188:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313244928:0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.511232:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313243648:0@lo:400:kworker.0 00010000:00080000:3.0:1788813041.511261:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489434e5f80 x1875706313244160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813041.511286:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313244160:0@lo:400:kworker.0 00010000:00080000:3.0:1788813041.511314:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489434e6d80 x1875706313244672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813041.511324:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313244672:0@lo:400:kworker.0 00000100:00100000:3.0:1788813041.511342:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313243776:0@lo:400:kworker.0 00010000:00080000:3.0:1788813041.511360:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489434e5c00 x1875706313244288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813041.511370:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313244288:0@lo:400:kworker.0 00010000:00080000:3.0:1788813041.511384:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489434e4700 x1875706313244800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813041.511395:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313244800:0@lo:400:kworker.0 00000100:00100000:1.0:1788813041.512116:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313244416:12345-0@lo:400:kworker.0 Request processed in 1652us (2483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813041.512125:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788813041.512862:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489434e7100 x1875706313244416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813041.512878:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313244416:0@lo:400:kworker.0 00000100:00100000:2.0:1788813041.537187:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813041.537241:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813041.537255:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301652992 00000100:00100000:0.0:1788813041.537272:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301652992 00000100:00100000:1.0:1788813041.537294:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301653248 00000100:00100000:1.0:1788813041.537306:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301653248 00000100:00100000:1.0:1788813041.537394:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:0.0:1788813041.537394:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 61 00000100:00080000:2.0:1788813041.537408:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813041.537417:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813041.537436:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301653248:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813041.537440:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301652992:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813041.537562:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301652992:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 146us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813041.537567:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301653248:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 149us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813041.537581:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 61 00000100:00100000:1.0:1788813041.537589:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:2.0:1788813041.537710:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813041.537757:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301652864 00000100:00100000:1.0:1788813041.537768:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301652864 00000100:00100000:1.0:1788813041.537808:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 271 00000100:00100000:1.0:1788813041.537815:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:2397:x1875706301652864:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813041.537846:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:2397:x1875706301652864:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 31us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813041.537853:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 271 00000100:00100000:2.0:1788813041.538570:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813041.538649:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813041.538700:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301653120 00000100:00100000:0.0:1788813041.538707:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301653120 00000100:00100000:1.0:1788813041.538785:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301653376 00000100:00100000:1.0:1788813041.538793:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301653376 00000100:00100000:0.0:1788813041.538803:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 62 00000100:00100000:0.0:1788813041.538816:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301653120:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813041.538884:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301653120:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 71us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813041.538906:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 62 00000100:00100000:1.0:1788813041.539308:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 26 00000100:00080000:2.0:1788813041.539310:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813041.539322:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301653376:12345-192.168.202.13@tcp:400:kworker.0 00000100:00080000:2.0:1788813041.539323:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788813041.539442:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301653376:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 124us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813041.539449:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 26 00010000:00010000:0.0:1788813042.532189:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813043.556135:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813044.580219:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313245184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813044.580321:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813044.580411:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313245184 00000100:00100000:2.0:1788813044.580422:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313245184 00010000:00010000:0.0:1788813044.580430:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813044.580495:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788813044.580512:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313245184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788813044.580549:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813044.580605:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313245184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813044.580613:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788813044.580643:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813044.580676:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313245312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813044.580729:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788813044.580791:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e06300 x1875706313245184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813044.580813:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313245184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813044.582813:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313245312 00000100:00100000:2.0:1788813044.582835:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313245312 00000100:00100000:2.0:1788813044.583024:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788813044.583039:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313245312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813044.583077:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813044.583180:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313245312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (2451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813044.583187:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788813044.583269:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e04a80 x1875706313245312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813044.583300:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313245312:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788813044.583374:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788813045.604079:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813045.604131:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813045.604154:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313245440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813045.604225:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813045.604294:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313245440 00000100:00100000:1.0:1788813045.604303:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313245440 00000100:00100000:1.0:1788813045.604356:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788813045.604367:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313245440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788813045.604403:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788813045.604466:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313245440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813045.604473:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788813045.604575:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313245440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813046.119195:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313245568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813046.119266:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813046.119644:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313245568 00000100:00100000:3.0:1788813046.119653:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313245568 00000100:00100000:3.0:1788813046.119699:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788813046.119719:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313245568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788813046.119753:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788813046.119802:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313245568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813046.119809:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788813046.120222:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313245568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813046.628405:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313245824:0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.628471:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813046.628520:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894369b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313246336:0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.628541:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813046.628562:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313246848:0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.628580:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813046.628601:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788813046.628606:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313245696:0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.628632:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813046.628651:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313246208:0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.628669:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813046.628682:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894369a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313246720:0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.628701:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813046.628726:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313245824 00000100:00100000:3.0:1788813046.628733:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313245824 00000100:00100000:3.0:1788813046.628768:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313246336 00000100:00100000:3.0:1788813046.628771:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313246336 00000100:00100000:3.0:1788813046.628791:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313246848 00000100:00100000:3.0:1788813046.628793:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313246848 00000100:00100000:3.0:1788813046.628803:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313246208 00000100:00100000:3.0:1788813046.628805:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313246208 00000100:00100000:3.0:1788813046.628828:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313246720 00000100:00100000:3.0:1788813046.628830:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313246720 00000100:00100000:3.0:1788813046.628843:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788813046.628849:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313245824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.628914:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313245824:12345-0@lo:400:kworker.0 Request processed in 64us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813046.628920:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788813046.628961:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788813046.628968:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313246336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.628995:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313246336:12345-0@lo:400:kworker.0 Request processed in 29us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813046.629000:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788813046.629012:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788813046.629017:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313246848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.629057:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313246848:12345-0@lo:400:kworker.0 Request processed in 39us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813046.629064:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788813046.629077:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788813046.629082:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313246208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.629109:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313246208:12345-0@lo:400:kworker.0 Request processed in 27us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813046.629115:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788813046.629127:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788813046.629133:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313246720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.629158:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313246720:12345-0@lo:400:kworker.0 Request processed in 26us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813046.629173:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1788813046.629194:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813046.629198:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313245696 00000100:00100000:3.0:1788813046.629203:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313245696 00000100:00100000:0.0:1788813046.629221:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313245952:0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.629233:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788813046.629242:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3628:x1875706313245696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813046.629259:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813046.629352:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313245952 00000100:00100000:2.0:1788813046.629355:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313245952 00000100:00100000:2.0:1788813046.629377:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788813046.629382:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313245952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.629492:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3628:x1875706313245696:12345-0@lo:400:kworker.0 Request processed in 251us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813046.629499:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:3.0:1788813046.629526:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813046.629531:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788813046.629554:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313245696:0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.629566:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313246208:0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.629574:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894369a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313246720:0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.629583:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313245824:0@lo:400:kworker.0 00010000:00080000:3.0:1788813046.629593:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894369b480 x1875706313246336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813046.629603:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894369b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313246336:0@lo:400:kworker.0 00010000:00080000:3.0:1788813046.629611:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943699f80 x1875706313246848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813046.629619:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313246848:0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.629639:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813046.629644:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313247232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813046.629667:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813046.629715:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313247232 00000100:00100000:3.0:1788813046.629719:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313247232 00000100:00100000:3.0:1788813046.629745:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788813046.629751:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313247232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813046.629789:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813046.629822:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313247232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813046.629828:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788813046.629842:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788813046.629858:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943527b80 x1875706313247232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813046.629871:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313247232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813046.629914:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894369b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313246080:0@lo:400:kworker.0 00000100:00100000:1.0:1788813046.630061:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813046.630073:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313247360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813046.630098:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813046.630128:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313247360 00000100:00100000:1.0:1788813046.630131:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313247360 00000100:00100000:1.0:1788813046.630158:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788813046.630164:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313247360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788813046.630175:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813046.630189:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313246464:0@lo:400:kworker.0 00000100:00100000:1.0:1788813046.630209:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313247360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813046.630217:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788813046.630227:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788813046.630247:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943641f80 x1875706313247360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813046.630255:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313246976:0@lo:400:kworker.0 00000100:00100000:1.0:1788813046.630264:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313247360:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788813046.630282:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813046.630286:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813046.630348:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813046.630367:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313246592:0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.630385:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813046.630431:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313245952:12345-0@lo:400:kworker.0 Request processed in 1048us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813046.630438:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788813046.630509:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313247104:0@lo:400:kworker.0 00000100:00100000:0.0:1788813046.630518:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313245952:0@lo:400:kworker.0 00000100:00100000:3.0:1788813046.630532:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813046.630552:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313246080 00000100:00100000:1.0:1788813046.630555:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313246464 00000100:00100000:1.0:1788813046.630560:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313246464 00000100:00100000:0.0:1788813046.630563:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313246080 00000100:00100000:1.0:1788813046.630591:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313246976 00000100:00100000:1.0:1788813046.630595:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313246976 00000100:00100000:1.0:1788813046.630615:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313246592 00000100:00100000:0.0:1788813046.630617:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788813046.630618:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313246592 00000100:00100000:0.0:1788813046.630629:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313246080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813046.630637:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813046.630645:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313246464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813046.630691:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313246464:12345-0@lo:400:kworker.0 Request processed in 47us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813046.630696:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813046.630706:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788813046.630711:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313246976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813046.630743:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313246976:12345-0@lo:400:kworker.0 Request processed in 32us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813046.630748:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788813046.630758:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788813046.630763:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313246592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813046.630887:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313246080:12345-0@lo:400:kworker.0 Request processed in 261us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813046.630895:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788813046.630956:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943698e00 x1875706313246464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813046.630960:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313247104 00000100:00100000:2.0:1788813046.630965:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313247104 00000100:00100000:2.0:1788813046.630987:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788813046.630993:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313247104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813046.631056:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313246464:0@lo:400:kworker.0 00000100:00100000:1.0:1788813046.631293:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313246592:12345-0@lo:400:kworker.0 Request processed in 528us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813046.631300:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788813046.631312:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943699c00 x1875706313246976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788813046.631314:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813046.631473:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894369b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313246080:0@lo:400:kworker.0 00010000:00080000:3.0:1788813046.631484:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943698a80 x1875706313246592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813046.631491:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313246592:0@lo:400:kworker.0 00000100:00100000:0.0:1788813046.631521:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313246976:0@lo:400:kworker.0 00000100:00100000:2.0:1788813046.631523:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313247104:12345-0@lo:400:kworker.0 Request processed in 528us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813046.631543:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788813046.631609:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894369aa00 x1875706313247104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813046.631630:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313247104:0@lo:400:kworker.0 00000100:00100000:2.0:1788813046.659502:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813046.659547:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813046.659629:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813046.659658:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301653632 00000100:00100000:2.0:1788813046.659667:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301653632 00000100:00100000:2.0:1788813046.659722:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301653760 00000100:00100000:2.0:1788813046.659726:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301653760 00000100:00100000:2.0:1788813046.659750:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 69 00000100:00100000:2.0:1788813046.659759:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2396:x1875706301653632:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813046.659823:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2396:x1875706301653632:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 65us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813046.659831:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 69 00000100:00100000:2.0:1788813046.659856:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 70 00000100:00100000:2.0:1788813046.659862:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301653760:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813046.659885:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301653760:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813046.659891:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 70 00000100:00080000:2.0:1788813046.659909:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788813046.659913:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813046.660250:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301653504 00000100:00100000:0.0:1788813046.660256:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301653504 00000100:00100000:0.0:1788813046.660300:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 273 00000100:00100000:0.0:1788813046.660308:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+10:2396:x1875706301653504:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813046.660343:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+10:2396:x1875706301653504:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 35us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813046.660349:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813046.660358:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 273 00000100:00100000:1.0:1788813046.660406:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301653888 00000100:00100000:1.0:1788813046.660413:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301653888 00000100:00100000:1.0:1788813046.660473:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:1.0:1788813046.660483:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2395:x1875706301653888:12345-192.168.202.13@tcp:9:kworker.0 00000100:00080000:0.0:1788813046.660486:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788813046.660521:0:8405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702946 00000100:00100000:3.0:1788813046.660536:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00080000:1.0:1788813046.660565:0:8405:0:(import.c:65:import_set_state_nolock()) ffff948941922000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788813046.660572:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301654016 00000100:00100000:0.0:1788813046.660578:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301654016 00010000:00010000:3.0:1788813046.660593:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813046.660619:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 19 00000001:00000004:1.0:1788813046.660625:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788813046.660631:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2395:x1875706301654016:12345-192.168.202.13@tcp:9:kworker.0 00000020:00000080:0.0:1788813046.660651:0:8403:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff70294d 00000100:00080000:0.0:1788813046.660659:0:8403:0:(import.c:65:import_set_state_nolock()) ffff948941927800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788813046.660710:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788813046.660715:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788813046.660777:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+2:2395:x1875706301653888:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 295us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813046.660785:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:0.0:1788813046.660809:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+2:2395:x1875706301654016:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 181us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813046.660818:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00080000:0.0:1788813046.660843:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1788813047.104783:0:11963:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:30:47 (1788813047) === 00000100:00100000:3.0:1788813047.369355:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813047.369799:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301654144 00000100:00100000:1.0:1788813047.369813:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301654144 00000100:00100000:1.0:1788813047.369888:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 274 00000100:00100000:1.0:1788813047.369899:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+10:8701:x1875706301654144:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788813047.369921:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813047.369972:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a07295e0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813047.370052:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07295e0 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813047.370066:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07295e0 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813047.370076:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8200, rc 0) 00000100:00100000:1.0:1788813047.370146:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+11:8701:x1875706301654144:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 248us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813047.370153:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 274 00000100:00100000:2.0:1788813047.378677:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813047.378753:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301654272 00000100:00100000:0.0:1788813047.378763:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301654272 00000100:00100000:0.0:1788813047.378980:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 275 00000100:00100000:0.0:1788813047.378992:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+11:8701:x1875706301654272:12345-192.168.202.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788813047.379162:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+11:8701:x1875706301654272:12345-192.168.202.13@tcp:501:mount.lustre.0 Request processed in 160us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813047.379170:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 275 00000100:00100000:3.0:1788813047.380891:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813047.380966:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301654400 00000100:00100000:0.0:1788813047.380976:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301654400 00000100:00100000:0.0:1788813047.381022:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 276 00000100:00100000:0.0:1788813047.381048:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+11:8701:x1875706301654400:12345-192.168.202.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788813047.381230:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+11:8701:x1875706301654400:12345-192.168.202.13@tcp:503:mount.lustre.0 Request processed in 184us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813047.381235:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 276 00000100:00100000:3.0:1788813047.384118:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813047.387132:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301654528 00000100:00100000:0.0:1788813047.387152:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301654528 00000100:00100000:0.0:1788813047.387314:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 277 00000100:00100000:0.0:1788813047.387326:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+11:8705:x1875706301654528:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813047.392321:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+11:8705:x1875706301654528:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 4982us (8197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813047.392367:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 277 00000100:00100000:2.0:1788813047.407637:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813047.407980:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301654656 00000100:00100000:0.0:1788813047.408149:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301654656 00000100:00100000:0.0:1788813047.408928:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 278 00000100:00100000:0.0:1788813047.409145:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+11:8705:x1875706301654656:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813047.410540:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+11:8705:x1875706301654656:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 1547us (2908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813047.410552:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 278 00000100:00100000:3.0:1788813047.418008:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813047.418151:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301654784 00000100:00100000:0.0:1788813047.418165:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301654784 00000100:00100000:0.0:1788813047.418343:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 279 00000100:00100000:0.0:1788813047.418357:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+11:8705:x1875706301654784:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813047.418554:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+11:8705:x1875706301654784:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 200us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813047.418562:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 279 00000100:00100000:3.0:1788813047.425284:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813047.425715:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301654912 00000100:00100000:0.0:1788813047.425730:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301654912 00000100:00100000:0.0:1788813047.425801:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 280 00000100:00100000:0.0:1788813047.425814:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+11:8701:x1875706301654912:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788813047.425835:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813047.425857:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cda400/0xf32533d6ff702af8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729611 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813047.425894:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cda400/0xf32533d6ff702af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729611 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813047.425923:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cda400/0xf32533d6ff702af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729611 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813047.425973:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cda400, rc 0) 00000100:00100000:0.0:1788813047.426055:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+12:8701:x1875706301654912:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 244us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813047.426066:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 280 00000100:00100000:2.0:1788813047.428216:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813047.428291:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301655040 00000100:00100000:0.0:1788813047.428300:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301655040 00000100:00100000:0.0:1788813047.428350:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 281 00000100:00100000:0.0:1788813047.428361:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+12:8701:x1875706301655040:12345-192.168.202.13@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788813047.428389:0:6488:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788813047.428418:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788813047.428423:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788813047.428427:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788813047.428430:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788813047.428433:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788813047.429169:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+12:8701:x1875706301655040:12345-192.168.202.13@tcp:256:mount.lustre.0 Request processed in 807us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813047.429178:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 281 00000100:00100000:3.0:1788813047.431745:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813047.431799:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301655168 00000100:00100000:0.0:1788813047.431808:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301655168 00000100:00100000:0.0:1788813047.431858:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 282 00000100:00100000:0.0:1788813047.431874:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+12:8701:x1875706301655168:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788813047.431896:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813047.431920:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff702aff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729618 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813047.432005:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff702aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729618 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813047.432018:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff702aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729618 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813047.432038:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdbe00, rc 0) 00000100:00100000:0.0:1788813047.432105:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:8701:x1875706301655168:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 239us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813047.432112:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 282 00000100:00100000:2.0:1788813047.432982:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813047.433063:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301655296 00000100:00100000:0.0:1788813047.433069:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301655296 00000100:00100000:0.0:1788813047.433172:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 283 00000100:00100000:0.0:1788813047.433183:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:8701:x1875706301655296:12345-192.168.202.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788813047.433337:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:8701:x1875706301655296:12345-192.168.202.13@tcp:501:mount.lustre.0 Request processed in 156us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813047.433345:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 283 00000100:00100000:2.0:1788813047.433993:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813047.434056:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301655424 00000100:00100000:0.0:1788813047.434062:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301655424 00000100:00100000:0.0:1788813047.434138:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 284 00000100:00100000:0.0:1788813047.434145:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:8701:x1875706301655424:12345-192.168.202.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788813047.434239:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:8701:x1875706301655424:12345-192.168.202.13@tcp:503:mount.lustre.0 Request processed in 94us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813047.434247:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 284 00000100:00100000:3.0:1788813047.439542:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813047.439619:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301655552 00000100:00100000:0.0:1788813047.439649:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301655552 00000100:00100000:0.0:1788813047.439713:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 285 00000100:00100000:0.0:1788813047.439730:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:8710:x1875706301655552:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813047.439919:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:8710:x1875706301655552:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 195us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813047.439928:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 285 00000100:00100000:2.0:1788813047.442613:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813047.442747:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301655680 00000100:00100000:0.0:1788813047.442761:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301655680 00000100:00100000:0.0:1788813047.442823:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 286 00000100:00100000:0.0:1788813047.442835:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:8710:x1875706301655680:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813047.443226:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:8710:x1875706301655680:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 391us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813047.443236:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 286 00000100:00100000:2.0:1788813047.450142:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813047.450186:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813047.450231:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301656448 00000100:00100000:3.0:1788813047.450246:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301656448 00000100:00100000:0.0:1788813047.450270:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301656576 00000100:00100000:0.0:1788813047.450277:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301656576 00000100:00100000:3.0:1788813047.450392:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 71 00000100:00100000:3.0:1788813047.450405:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2399:x1875706301656448:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813047.450768:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:0.0:1788813047.450778:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301656576:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813047.450790:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2399:x1875706301656448:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 386us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813047.450799:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 71 00000100:00100000:0.0:1788813047.450815:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301656576:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 38us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813047.450823:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:1.0:1788813047.451041:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813047.451075:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813047.451094:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301655808 00000100:00100000:1.0:1788813047.451100:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301655808 00000100:00100000:0.0:1788813047.451177:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301656064 00000100:00100000:0.0:1788813047.451181:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301656064 00000100:00100000:1.0:1788813047.451268:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:1.0:1788813047.451276:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1875706301655808:12345-192.168.202.13@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788813047.451306:0:6495:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 811c25ff-4ab1-402b-924d-5308c16318af@192.168.202.13@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:1.0:1788813047.451351:0:6495:0:(genops.c:1384:class_connect()) connect: client 811c25ff-4ab1-402b-924d-5308c16318af, cookie 0xf32533d6ff702b06 00000004:00100000:1.0:1788813047.451383:0:6495:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788813047.451525:0:6495:0:(import.c:65:import_set_state_nolock()) ffff948943449000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813047.451574:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+6:2395:x1875706301655808:12345-192.168.202.13@tcp:38:mount.lustre.0 Request processed in 298us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813047.451582:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:1.0:1788813047.451596:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:1.0:1788813047.451601:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1875706301656064:12345-192.168.202.13@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788813047.451634:0:6495:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 811c25ff-4ab1-402b-924d-5308c16318af@192.168.202.13@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:1.0:1788813047.451663:0:6495:0:(genops.c:1384:class_connect()) connect: client 811c25ff-4ab1-402b-924d-5308c16318af, cookie 0xf32533d6ff702b0d 00000004:00100000:1.0:1788813047.451677:0:6495:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788813047.451737:0:6495:0:(import.c:65:import_set_state_nolock()) ffff94894344f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813047.451771:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+6:2395:x1875706301656064:12345-192.168.202.13@tcp:38:mount.lustre.0 Request processed in 168us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813047.451780:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:2.0:1788813047.454420:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813047.454545:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301656192 00000100:00100000:0.0:1788813047.454557:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301656192 00000100:00100000:2.0:1788813047.454597:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813047.454641:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301655936 00000100:00100000:0.0:1788813047.454645:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301655936 00000100:00100000:2.0:1788813047.454659:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:2.0:1788813047.454675:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+6:0:x1875706301656192:12345-192.168.202.13@tcp:41:mount.lustre.0 00000100:00100000:0.0:1788813047.454681:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00100000:0.0:1788813047.454694:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+6:0:x1875706301655936:12345-192.168.202.13@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788813047.454730:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000004:00000024:0.0:1788813047.454731:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788813047.454853:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+6:0:x1875706301656192:12345-192.168.202.13@tcp:41:mount.lustre.0 Request processed in 180us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813047.454854:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+6:0:x1875706301655936:12345-192.168.202.13@tcp:41:mount.lustre.0 Request processed in 159us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813047.454870:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:0.0:1788813047.454877:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00100000:2.0:1788813047.455340:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00080000:1.0:1788813047.455367:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813047.455374:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788813047.455469:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301656320 00000100:00100000:3.0:1788813047.455476:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301656320 00000100:00100000:3.0:1788813047.455807:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:3.0:1788813047.455817:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+6:8701:x1875706301656320:12345-192.168.202.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788813047.455836:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788813047.455883:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+6:8701:x1875706301656320:12345-192.168.202.13@tcp:41:mount.lustre.0 Request processed in 69us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813047.455900:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:1.0:1788813047.456978:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813047.457207:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301656704 00000100:00100000:3.0:1788813047.457215:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301656704 00000100:00100000:3.0:1788813047.457259:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:3.0:1788813047.457268:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+6:8701:x1875706301656704:12345-192.168.202.13@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788813047.457336:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+6:8701:x1875706301656704:12345-192.168.202.13@tcp:40:mount.lustre.0 Request processed in 69us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813047.457344:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:2.0:1788813047.458550:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813047.458669:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301657088 00000100:00100000:1.0:1788813047.458678:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301657088 00000100:00100000:1.0:1788813047.458836:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:1.0:1788813047.458847:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:811c25ff-4ab1-402b-924d-5308c16318af+6:8701:x1875706301657088:12345-192.168.202.13@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788813047.458966:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:811c25ff-4ab1-402b-924d-5308c16318af+6:8701:x1875706301657088:12345-192.168.202.13@tcp:900:mount.lustre.0 Request processed in 81us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813047.458975:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:2.0:1788813047.459429:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813047.459467:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813047.459513:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301656832 00000100:00100000:3.0:1788813047.459520:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301656832 00000100:00100000:3.0:1788813047.459554:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301656960 00000100:00100000:3.0:1788813047.459557:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301656960 00000100:00100000:3.0:1788813047.459580:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:3.0:1788813047.459586:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a766b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2395:x1875706301656832:12345-192.168.202.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788813047.459619:0:10066:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 811c25ff-4ab1-402b-924d-5308c16318af@192.168.202.13@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1788813047.459655:0:10066:0:(genops.c:1384:class_connect()) connect: client 811c25ff-4ab1-402b-924d-5308c16318af, cookie 0xf32533d6ff702b14 00002000:00100000:3.0:1788813047.459670:0:10066:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 811c25ff-4ab1-402b-924d-5308c16318af/ffff948a7b792800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788813047.459694:0:10066:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788813047.459778:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:1.0:1788813047.459784:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1875706301656960:12345-192.168.202.13@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788813047.459805:0:8405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 811c25ff-4ab1-402b-924d-5308c16318af@192.168.202.13@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:1.0:1788813047.459830:0:8405:0:(genops.c:1384:class_connect()) connect: client 811c25ff-4ab1-402b-924d-5308c16318af, cookie 0xf32533d6ff702b1b 00002000:00100000:1.0:1788813047.459835:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 811c25ff-4ab1-402b-924d-5308c16318af/ffff94894344b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788813047.459844:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788813047.459958:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788813047.460008:0:8405:0:(import.c:65:import_set_state_nolock()) ffff948943448000 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1788813047.460289:0:10066:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1788813047.460316:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:811c25ff-4ab1-402b-924d-5308c16318af+6:2395:x1875706301656960:12345-192.168.202.13@tcp:8:mount.lustre.0 Request processed in 525us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813047.460326:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00080000:3.0:1788813047.460347:0:10066:0:(import.c:65:import_set_state_nolock()) ffff948a7b794800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813047.460403:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a766b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:811c25ff-4ab1-402b-924d-5308c16318af+6:2395:x1875706301656832:12345-192.168.202.13@tcp:8:mount.lustre.0 Request processed in 814us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813047.460420:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:1.0:1788813047.461246:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813047.461330:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301657216 00000100:00100000:3.0:1788813047.461337:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301657216 00000100:00100000:3.0:1788813047.461575:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 1 00000100:00100000:3.0:1788813047.461585:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:811c25ff-4ab1-402b-924d-5308c16318af+6:8701:x1875706301657216:12345-192.168.202.13@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788813047.461677:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788813047.461750:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:811c25ff-4ab1-402b-924d-5308c16318af+6:8701:x1875706301657216:12345-192.168.202.13@tcp:33:mount.lustre.0 Request processed in 167us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813047.461757:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 1 00010000:00010000:0.0:1788813047.652104:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813048.679315:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813049.700389:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313247488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813049.700444:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813049.700642:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813049.700703:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313247616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813049.700723:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813049.700787:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313247488 00000100:00100000:3.0:1788813049.700796:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313247488 00000100:00100000:1.0:1788813049.700804:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313247616 00000100:00100000:1.0:1788813049.700809:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313247616 00000100:00100000:1.0:1788813049.700863:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788813049.700867:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813049.700871:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313247616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788813049.700905:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813049.700926:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788813049.700985:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313247488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813049.700996:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813049.701056:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313247616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 185us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813049.701062:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788813049.701181:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccf9880 x1875706313247616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813049.701198:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313247616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813049.701207:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313247488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 272us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813049.701215:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788813049.701302:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894369b100 x1875706313247488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813049.701315:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313247488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813050.724382:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813050.724401:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313247744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813050.724456:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813050.725280:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813050.728359:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313247744 00000100:00100000:2.0:1788813050.728376:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313247744 00000100:00100000:2.0:1788813050.728439:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788813050.728450:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313247744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813050.728487:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788813050.728569:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313247744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (4110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813050.728577:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788813050.728609:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313247744:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1788813050.916438:0:12156:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1788813051.237909:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313247872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813051.238050:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813051.238255:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313247872 00000100:00100000:0.0:1788813051.238262:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313247872 00000100:00100000:0.0:1788813051.238303:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788813051.238309:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313247872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788813051.238336:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788813051.238374:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313247872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813051.238379:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788813051.238584:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313247872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813051.529448:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813051.529501:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813051.529538:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813051.529579:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813051.529598:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813051.529616:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813051.529637:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813051.529670:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301657984 00000100:00100000:2.0:1788813051.529680:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301657984 00000100:00100000:2.0:1788813051.529736:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301658112 00000100:00100000:2.0:1788813051.529739:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301658112 00000100:00100000:2.0:1788813051.529766:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:2.0:1788813051.529776:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:811c25ff-4ab1-402b-924d-5308c16318af+6:2398:x1875706301657984:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813051.529847:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:811c25ff-4ab1-402b-924d-5308c16318af+6:2398:x1875706301657984:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 73us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813051.529856:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:2.0:1788813051.529873:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 32 00000100:00100000:2.0:1788813051.529880:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:811c25ff-4ab1-402b-924d-5308c16318af+6:2398:x1875706301658112:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813051.529903:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:811c25ff-4ab1-402b-924d-5308c16318af+6:2398:x1875706301658112:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813051.529909:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 32 00000100:00080000:2.0:1788813051.529925:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813051.529929:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813051.530054:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301657472 00000100:00100000:0.0:1788813051.530060:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301657472 00000100:00100000:0.0:1788813051.530090:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301657728 00000100:00100000:0.0:1788813051.530093:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301657728 00000100:00100000:0.0:1788813051.530106:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301657600 00000100:00100000:0.0:1788813051.530108:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301657600 00000100:00100000:0.0:1788813051.530120:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301657856 00000100:00100000:0.0:1788813051.530134:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301657856 00000100:00100000:0.0:1788813051.530151:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 73 00000100:00100000:0.0:1788813051.530158:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2398:x1875706301657472:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813051.530191:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2398:x1875706301657472:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 34us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813051.530197:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 73 00000100:00100000:0.0:1788813051.530211:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 74 00000100:00100000:0.0:1788813051.530217:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+6:2398:x1875706301657728:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813051.530238:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+6:2398:x1875706301657728:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 22us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813051.530243:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 74 00000100:00100000:0.0:1788813051.530254:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 75 00000100:00100000:0.0:1788813051.530259:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301657600:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813051.530388:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 76 00000100:00100000:3.0:1788813051.530397:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+6:2398:x1875706301657856:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813051.530477:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301657344 00000100:00100000:2.0:1788813051.530482:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301657344 00000100:00100000:2.0:1788813051.530511:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 287 00000100:00100000:2.0:1788813051.530518:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301657344:12345-192.168.202.13@tcp:400:kworker.0 00000100:00080000:1.0:1788813051.537198:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788813051.537212:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813051.541554:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301657600:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 11279us (11939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813051.541571:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 75 00000100:00100000:3.0:1788813051.544396:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+6:2398:x1875706301657856:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 13986us (14765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813051.544428:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 76 00000100:00100000:2.0:1788813051.545793:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301657344:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 15265us (16203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813051.545806:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 287 00010000:00010000:3.0:1788813051.748291:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813051.749416:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313248128:0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.749498:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813051.749544:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313248640:0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.749566:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813051.749591:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313249152:0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.749612:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813051.749636:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788813051.749642:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313248000:0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.749678:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813051.749698:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313248512:0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.749719:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813051.749738:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313249024:0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.749772:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813051.749795:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313248384:0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.749818:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813051.749834:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313248896:0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.749855:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813051.750080:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313248128 00000100:00100000:3.0:1788813051.750098:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313248128 00000100:00100000:3.0:1788813051.750136:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313248640 00000100:00100000:3.0:1788813051.750139:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313248640 00000100:00100000:3.0:1788813051.750162:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313249152 00000100:00100000:3.0:1788813051.750165:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313249152 00000100:00100000:3.0:1788813051.750177:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313248512 00000100:00100000:3.0:1788813051.750180:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313248512 00000100:00100000:3.0:1788813051.750191:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313249024 00000100:00100000:3.0:1788813051.750194:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313249024 00000100:00100000:3.0:1788813051.750208:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788813051.750217:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313248128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813051.750270:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313248128:12345-0@lo:400:kworker.0 Request processed in 54us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813051.750277:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788813051.750294:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788813051.750301:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313248640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813051.750329:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313248640:12345-0@lo:400:kworker.0 Request processed in 29us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813051.750334:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788813051.750346:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788813051.750351:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313249152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813051.750374:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313249152:12345-0@lo:400:kworker.0 Request processed in 24us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813051.750380:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788813051.750399:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788813051.750405:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313248512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813051.750432:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313248512:12345-0@lo:400:kworker.0 Request processed in 28us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813051.750437:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788813051.750447:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788813051.750452:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313249024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813051.750488:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313249024:12345-0@lo:400:kworker.0 Request processed in 36us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813051.750493:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788813051.750512:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813051.750516:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788813051.750550:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313248512:0@lo:400:kworker.0 00000100:00100000:3.0:1788813051.750561:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313249024:0@lo:400:kworker.0 00000100:00100000:3.0:1788813051.750568:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313248128:0@lo:400:kworker.0 00010000:00080000:3.0:1788813051.750577:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e07480 x1875706313248640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813051.750587:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313248640:0@lo:400:kworker.0 00010000:00080000:3.0:1788813051.750595:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e04a80 x1875706313249152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813051.750602:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313249152:0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.750801:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313249408:0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.750825:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813051.750844:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788813051.750850:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313248256:0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.750883:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813051.750900:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313248768:0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.750949:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813051.750966:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313249280:0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.750995:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813051.751020:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313248896 00000100:00100000:0.0:1788813051.751024:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313248896 00000100:00100000:0.0:1788813051.751050:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313249408 00000100:00100000:0.0:1788813051.751053:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313249408 00000100:00100000:0.0:1788813051.751063:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313248768 00000100:00100000:0.0:1788813051.751065:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313248768 00000100:00100000:0.0:1788813051.751075:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313249280 00000100:00100000:0.0:1788813051.751078:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313249280 00000100:00100000:0.0:1788813051.751294:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788813051.751299:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313248896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.751336:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313248896:12345-0@lo:400:kworker.0 Request processed in 37us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813051.751342:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788813051.751354:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788813051.751359:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313249408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.751381:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313249408:12345-0@lo:400:kworker.0 Request processed in 23us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813051.751386:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788813051.751394:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788813051.751398:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313248768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.751416:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313248768:12345-0@lo:400:kworker.0 Request processed in 19us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813051.751420:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788813051.751428:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788813051.751433:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313249280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.751452:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313249280:12345-0@lo:400:kworker.0 Request processed in 19us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813051.751456:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788813051.751537:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813051.751539:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813051.751546:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313248256 00000100:00100000:0.0:1788813051.751550:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313248256 00000100:00100000:0.0:1788813051.751569:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788813051.751574:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313248256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813051.751610:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313248256:12345-0@lo:400:kworker.0 Request processed in 36us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813051.751616:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788813051.751645:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313248256:0@lo:400:kworker.0 00010000:00080000:0.0:1788813051.751657:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e04e00 x1875706313248768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813051.751667:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313248768:0@lo:400:kworker.0 00010000:00080000:0.0:1788813051.751676:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e06300 x1875706313249280/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813051.751684:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313249280:0@lo:400:kworker.0 00010000:00080000:0.0:1788813051.751693:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e06d80 x1875706313248896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813051.751701:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313248896:0@lo:400:kworker.0 00010000:00080000:0.0:1788813051.751709:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7fd90000 x1875706313249408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813051.751715:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313249408:0@lo:400:kworker.0 00000100:00100000:2.0:1788813051.751894:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313248000 00000100:00100000:2.0:1788813051.751898:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313248000 00000100:00100000:2.0:1788813051.751958:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788813051.751966:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313248000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813051.752014:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313248000:12345-0@lo:400:kworker.0 Request processed in 49us (2335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813051.752020:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788813051.752048:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313248384 00000100:00100000:2.0:1788813051.752052:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313248384 00000100:00100000:2.0:1788813051.752077:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788813051.752083:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313248384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813051.752134:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313248384:12345-0@lo:400:kworker.0 Request processed in 51us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813051.752140:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788813051.752208:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313248000:0@lo:400:kworker.0 00000100:00100000:2.0:1788813051.752219:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813051.752225:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313249536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813051.752247:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813051.752274:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313249536 00000100:00100000:2.0:1788813051.752277:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313249536 00000100:00100000:2.0:1788813051.752300:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788813051.752307:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313249536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813051.752334:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813051.752365:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313249536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813051.752370:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788813051.752394:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccfbb80 x1875706313249536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813051.752408:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313249536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813051.752432:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313248384:0@lo:400:kworker.0 00000001:00100000:3.0:1788813051.753332:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 811c25ff-4ab1-402b-924d-5308c16318af 00000001:00100000:3.0:1788813051.753341:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000020:00000080:3.0:1788813051.753351:0:9483:0:(genops.c:885:class_export_put()) final put ffff948941920000/d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000020:00000080:2.0:1788813051.753408:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948941920000/d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 for lustre-OST0001 00000020:00000080:2.0:1788813051.753529:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948941927800 for lustre-OST0001 00000100:00100000:3.0:1788813051.757332:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813051.757353:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313249664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813051.757422:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813051.757508:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313249664 00000100:00100000:2.0:1788813051.757517:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313249664 00000100:00100000:2.0:1788813051.757579:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788813051.757592:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313249664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813051.757626:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813051.757695:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313249664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813051.757703:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788813051.757748:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943698a80 x1875706313249664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813051.757770:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313249664:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1788813051.760813:0:8399:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 811c25ff-4ab1-402b-924d-5308c16318af 00000001:00100000:0.0:1788813051.760826:0:8399:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000020:00000080:0.0:1788813051.760830:0:8399:0:(genops.c:885:class_export_put()) final put ffff948941927000/d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000020:00000080:1.0:1788813051.760906:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948941927000/d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 for lustre-OST0000 00000020:00000080:1.0:1788813051.761703:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948941922000 for lustre-OST0000 00010000:00010000:1.0:1788813052.772237:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788813052.775987:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 811c25ff-4ab1-402b-924d-5308c16318af 00000001:00100000:3.0:1788813052.776083:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 811c25ff-4ab1-402b-924d-5308c16318af 00010000:00010000:0.0:1788813053.796586:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813054.820284:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813054.821157:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313249792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813054.821254:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813054.821463:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313249920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813054.821495:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813054.821539:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313249792 00000100:00100000:3.0:1788813054.821547:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313249792 00000100:00100000:3.0:1788813054.821602:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313249920 00000100:00100000:3.0:1788813054.821604:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313249920 00000100:00100000:3.0:1788813054.821621:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788813054.821629:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313249792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813054.821663:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788813054.826309:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813054.826412:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788813054.826444:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313249920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788813054.826513:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813054.826656:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313249920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 229us (5158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813054.826666:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788813054.827068:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccfbb80 x1875706313249920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813054.827109:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313249920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813054.827281:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313249792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5649us (6025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813054.827290:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788813054.829105:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943699880 x1875706313249792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813054.829132:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313249792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813055.845243:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813055.845267:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313250048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813055.845339:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813055.845646:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313250048 00000100:00100000:2.0:1788813055.845655:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313250048 00000100:00100000:2.0:1788813055.845710:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788813055.845720:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313250048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813055.845753:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788813055.845826:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313250048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813055.845837:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788813055.845893:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313250048:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788813055.856023:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813056.356216:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813056.356239:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313250176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813056.356320:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813056.356755:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313250176 00000100:00100000:0.0:1788813056.356763:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313250176 00000100:00100000:0.0:1788813056.356818:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788813056.356828:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313250176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788813056.356860:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788813056.356917:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313250176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813056.356924:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788813056.357079:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313250176:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788813056.875062:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813056.875428:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313250432:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.875488:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813056.875529:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313250944:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.875549:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813056.875563:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313251456:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.875580:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813056.875598:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788813056.875604:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313250304:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.875627:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813056.875666:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313250816:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.875687:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813056.875703:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313251328:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.875734:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813056.875756:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313250560:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.875778:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813056.875789:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313251072:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.875810:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813056.875828:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313251584:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.875845:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813056.875863:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788813056.875868:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313250688:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.875888:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813056.875905:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313251200:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.875924:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813056.875972:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313251712:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.875992:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813056.876016:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313250432 00000100:00100000:0.0:1788813056.876023:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313250432 00000100:00100000:0.0:1788813056.876054:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313250944 00000100:00100000:0.0:1788813056.876056:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313250944 00000100:00100000:0.0:1788813056.876074:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313251456 00000100:00100000:0.0:1788813056.876076:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313251456 00000100:00100000:0.0:1788813056.876084:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313250816 00000100:00100000:0.0:1788813056.876086:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313250816 00000100:00100000:0.0:1788813056.876095:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313251328 00000100:00100000:0.0:1788813056.876096:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313251328 00000100:00100000:0.0:1788813056.876105:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313250560 00000100:00100000:0.0:1788813056.876107:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313250560 00000100:00100000:0.0:1788813056.876118:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788813056.876125:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313250432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.876175:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313250432:12345-0@lo:400:kworker.0 Request processed in 50us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813056.876183:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788813056.876201:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788813056.876208:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313250944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.876236:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313250944:12345-0@lo:400:kworker.0 Request processed in 29us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813056.876242:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788813056.876252:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788813056.876257:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313251456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.876280:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313251456:12345-0@lo:400:kworker.0 Request processed in 22us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813056.876285:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788813056.876293:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788813056.876298:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313250816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.876318:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313250816:12345-0@lo:400:kworker.0 Request processed in 20us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813056.876323:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788813056.876332:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788813056.876336:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313251328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.876358:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313251328:12345-0@lo:400:kworker.0 Request processed in 22us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813056.876363:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788813056.876372:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788813056.876377:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313250560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.876409:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313250560:12345-0@lo:400:kworker.0 Request processed in 32us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813056.876415:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788813056.876437:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313250304 00000100:00100000:0.0:1788813056.876440:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313250304 00000100:00100000:0.0:1788813056.876461:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788813056.876466:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3628:x1875706313250304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.876489:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3628:x1875706313250304:12345-0@lo:400:kworker.0 Request processed in 23us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813056.876495:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788813056.876521:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313251072 00000100:00100000:0.0:1788813056.876525:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313251072 00000100:00100000:0.0:1788813056.876543:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313251584 00000100:00100000:0.0:1788813056.876545:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313251584 00000100:00100000:0.0:1788813056.876556:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313251200 00000100:00100000:0.0:1788813056.876559:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313251200 00000100:00100000:0.0:1788813056.876570:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313251712 00000100:00100000:0.0:1788813056.876572:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313251712 00000100:00100000:0.0:1788813056.876581:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788813056.876587:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313251072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.876612:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313251072:12345-0@lo:400:kworker.0 Request processed in 25us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813056.876617:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788813056.876626:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788813056.876631:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313251584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.876651:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313251584:12345-0@lo:400:kworker.0 Request processed in 20us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813056.876665:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788813056.876674:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788813056.876680:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313251200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.876702:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313251200:12345-0@lo:400:kworker.0 Request processed in 23us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813056.876707:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788813056.876716:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788813056.876721:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313251712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.876743:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313251712:12345-0@lo:400:kworker.0 Request processed in 23us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813056.876748:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788813056.876767:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313250688 00000100:00100000:0.0:1788813056.876769:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313250688 00000100:00100000:0.0:1788813056.876789:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788813056.876794:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313250688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.876822:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313250688:12345-0@lo:400:kworker.0 Request processed in 28us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813056.876827:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788813056.876843:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813056.876847:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813056.876850:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813056.876851:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813056.876885:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313250688:0@lo:400:kworker.0 00010000:00080000:0.0:1788813056.876898:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76414000 x1875706313251200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813056.876909:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313251200:0@lo:400:kworker.0 00010000:00080000:0.0:1788813056.876962:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a764cb480 x1875706313251712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813056.876973:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313251712:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.876985:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313250560:0@lo:400:kworker.0 00010000:00080000:0.0:1788813056.876993:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76416d80 x1875706313251072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813056.877002:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313251072:0@lo:400:kworker.0 00010000:00080000:0.0:1788813056.877009:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76417b80 x1875706313251584/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813056.877017:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313251584:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.877048:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313250304:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.877057:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313250816:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.877065:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313251328:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.877073:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313250432:0@lo:400:kworker.0 00010000:00080000:0.0:1788813056.877081:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76416a00 x1875706313250944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813056.877090:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313250944:0@lo:400:kworker.0 00010000:00080000:0.0:1788813056.877098:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76414700 x1875706313251456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813056.877105:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313251456:0@lo:400:kworker.0 00000100:00100000:0.0:1788813056.877812:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813056.877823:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313251840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813056.877859:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813056.877893:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313251840 00000100:00100000:0.0:1788813056.877897:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313251840 00000100:00100000:0.0:1788813056.877955:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788813056.877963:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313251840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788813056.877986:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813056.878023:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313251840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813056.878029:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788813056.878061:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489419b5c00 x1875706313251840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813056.878076:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313251840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813056.879808:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813056.879825:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313251968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813056.879879:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813056.879992:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313251968 00000100:00100000:2.0:1788813056.879999:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313251968 00000100:00100000:2.0:1788813056.880037:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788813056.880044:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313251968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813056.880063:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813056.880100:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313251968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813056.880107:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788813056.880136:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccf8380 x1875706313251968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813056.880163:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313251968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813057.405837:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813057.405883:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813057.405970:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813057.406000:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813057.406018:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813057.406032:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813057.406046:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813057.406066:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301658368 00000100:00100000:0.0:1788813057.406075:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301658368 00000100:00100000:0.0:1788813057.406116:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301658496 00000100:00100000:0.0:1788813057.406118:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301658496 00000100:00100000:0.0:1788813057.406127:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301658752 00000100:00100000:0.0:1788813057.406128:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301658752 00000100:00100000:0.0:1788813057.406152:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301658624 00000100:00100000:0.0:1788813057.406154:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301658624 00000100:00100000:0.0:1788813057.406166:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 89 00000100:00100000:0.0:1788813057.406173:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301658368:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813057.406249:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301658368:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 77us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813057.406256:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 89 00000100:00100000:0.0:1788813057.406272:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 90 00000100:00100000:0.0:1788813057.406277:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301658496:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813057.406295:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301658496:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 19us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813057.406300:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 90 00000100:00100000:0.0:1788813057.406309:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 91 00000100:00100000:0.0:1788813057.406313:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301658752:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813057.406328:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301658752:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 15us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813057.406333:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 91 00000100:00100000:0.0:1788813057.406340:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 92 00000100:00100000:0.0:1788813057.406344:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301658624:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813057.406358:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301658624:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 13us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813057.406363:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 92 00000100:00100000:0.0:1788813057.406375:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301659008 00000100:00100000:0.0:1788813057.406378:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301659008 00000100:00100000:0.0:1788813057.406404:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301658880 00000100:00100000:0.0:1788813057.406407:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301658880 00000100:00100000:0.0:1788813057.406419:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 41 00000100:00100000:0.0:1788813057.406424:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301659008:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813057.406447:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301659008:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 23us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813057.406452:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 41 00000100:00100000:0.0:1788813057.406461:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 42 00000100:00100000:0.0:1788813057.406465:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301658880:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813057.406480:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301658880:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 15us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813057.406485:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 42 00000100:00080000:0.0:1788813057.406498:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813057.406501:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813057.406504:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788813057.406506:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813057.406746:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301658240 00000100:00100000:1.0:1788813057.406751:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301658240 00000100:00100000:1.0:1788813057.406790:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 290 00000100:00100000:1.0:1788813057.406797:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2396:x1875706301658240:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813057.406840:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2396:x1875706301658240:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 43us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813057.406850:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 290 00010000:00010000:1.0:1788813057.893987:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813058.921866:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788813059.613620:0:12471:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788813059.613829:0:12471:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788813059.950673:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813059.958689:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313252096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813059.958760:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813059.958837:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313252096 00000100:00100000:0.0:1788813059.958846:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313252096 00000100:00100000:0.0:1788813059.958898:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788813059.958917:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313252096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788813059.958975:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813059.959018:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313252096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813059.959024:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788813059.959053:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813059.959084:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76416a00 x1875706313252096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813059.959101:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313252096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813059.966068:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313252224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813059.966249:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813059.968106:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313252224 00000100:00100000:2.0:1788813059.968130:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313252224 00000100:00100000:2.0:1788813059.968192:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788813059.968202:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313252224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813059.968225:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813059.968288:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313252224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813059.968295:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788813059.968316:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788813059.968351:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943698a80 x1875706313252224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813059.968370:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313252224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813060.965067:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313252352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813060.965169:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813060.965220:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313252352 00000100:00100000:0.0:1788813060.965235:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313252352 00000100:00100000:0.0:1788813060.965297:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788813060.965307:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313252352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813060.965342:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788813060.965430:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313252352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813060.965437:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788813060.965547:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313252352:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788813060.965581:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813061.476371:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313252480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813061.476481:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813061.479039:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313252480 00000100:00100000:1.0:1788813061.479057:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313252480 00000100:00100000:1.0:1788813061.479131:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788813061.479144:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313252480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788813061.479192:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788813061.479299:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313252480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (2819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813061.479308:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788813061.479677:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313252480:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1788813061.958799:0:12568:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813061.959134:0:12568:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788813061.988383:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813061.988408:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313252608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813061.988474:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813061.988876:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313252608 00000100:00100000:0.0:1788813061.988884:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313252608 00000100:00100000:0.0:1788813061.988971:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788813061.988995:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313252608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813061.989025:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813061.989081:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313252608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813061.989088:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788813061.989109:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788813061.989144:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccfbb80 x1875706313252608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788813061.989153:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813061.989162:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313252608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813061.998172:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313252992:0@lo:400:kworker.0 00000100:00100000:1.0:1788813061.998249:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813061.998296:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813061.998303:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313252864:0@lo:400:kworker.0 00000100:00100000:1.0:1788813061.998330:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813061.998368:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313253120:0@lo:400:kworker.0 00000100:00100000:1.0:1788813061.998395:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813061.998412:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813061.998418:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313252736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813061.998441:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813061.999729:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313252736 00000100:00100000:2.0:1788813061.999752:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313252736 00000100:00100000:2.0:1788813061.999869:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788813061.999879:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313252736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813062.000495:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813062.000571:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313252736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 692us (2127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813062.000579:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788813062.000626:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccf9880 x1875706313252736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813062.000647:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313252736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813062.000868:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313252992 00000100:00100000:0.0:1788813062.000874:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313252992 00000100:00100000:0.0:1788813062.001012:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788813062.001028:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313252992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.001437:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313252992:12345-0@lo:400:kworker.0 Request processed in 410us (3187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813062.001445:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788813062.001467:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313252864 00000100:00100000:0.0:1788813062.001471:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313252864 00000100:00100000:0.0:1788813062.001499:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788813062.001505:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3628:x1875706313252864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.001536:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3628:x1875706313252864:12345-0@lo:400:kworker.0 Request processed in 31us (3204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813062.001542:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788813062.001573:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313253120 00000100:00100000:0.0:1788813062.001577:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313253120 00000100:00100000:0.0:1788813062.001601:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788813062.001607:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313253120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.001643:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313253120:12345-0@lo:400:kworker.0 Request processed in 36us (3247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813062.001649:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788813062.001690:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313253120:0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.001715:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313252864:0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.001726:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313252992:0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.007091:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313253376:0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.009014:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813062.009067:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313253888:0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.009123:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813062.009153:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788813062.009161:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313253504:0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.009420:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813062.009443:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313254016:0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.009462:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813062.009502:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313253888 00000100:00100000:0.0:1788813062.009509:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313253888 00000100:00080000:1.0:1788813062.009674:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813062.009680:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813062.010052:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813062.010062:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313253888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.010119:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313253888:12345-0@lo:400:kworker.0 Request processed in 59us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813062.010126:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813062.010152:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313253504 00000100:00100000:0.0:1788813062.010156:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313253504 00000100:00100000:3.0:1788813062.010503:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313253376 00000100:00100000:3.0:1788813062.010509:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313253376 00000100:00100000:3.0:1788813062.010537:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788813062.010544:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313253376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813062.010583:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313253376:12345-0@lo:400:kworker.0 Request processed in 40us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813062.010589:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788813062.011993:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313254016 00000100:00100000:3.0:1788813062.012004:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313254016 00000100:00100000:0.0:1788813062.012366:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1788813062.012428:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813062.018859:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313253504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813062.018907:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788813062.018917:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313254016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.019051:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313253504:12345-0@lo:400:kworker.0 Request processed in 6675us (9629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813062.019104:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788813062.019374:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313253504:0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.019388:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313253376:0@lo:400:kworker.0 00010000:00080000:0.0:1788813062.019402:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943533800 x1875706313253888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813062.019412:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313253888:0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.019588:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313253632:0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.019623:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813062.019646:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313254144:0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.019664:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813062.019681:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788813062.019687:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313253248:0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.019703:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813062.019712:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313253760:0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.019730:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813062.019752:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313253632 00000100:00100000:0.0:1788813062.019758:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313253632 00000100:00100000:0.0:1788813062.019777:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313254144 00000100:00100000:0.0:1788813062.019780:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313254144 00000100:00100000:0.0:1788813062.019791:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313253248 00000100:00100000:0.0:1788813062.019794:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313253248 00000100:00100000:0.0:1788813062.019805:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788813062.019809:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313253632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.019841:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313253632:12345-0@lo:400:kworker.0 Request processed in 31us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813062.019847:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788813062.019858:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788813062.019863:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313254144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813062.020037:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313254016:12345-0@lo:400:kworker.0 Request processed in 1121us (10573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813062.020037:0:9156:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788813062.020044:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788813062.020045:0:9156:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788813062.020059:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788813062.020066:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313253248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813062.020097:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313253248:12345-0@lo:400:kworker.0 Request processed in 32us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813062.020103:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788813062.020513:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313254144:12345-0@lo:400:kworker.0 Request processed in 648us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813062.020520:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788813062.020539:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313253760 00000100:00100000:0.0:1788813062.020551:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313253760 00000100:00100000:0.0:1788813062.020596:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788813062.020603:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313253760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.020634:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313253760:12345-0@lo:400:kworker.0 Request processed in 32us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813062.020640:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788813062.020671:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313254016:0@lo:400:kworker.0 00000100:00100000:0.0:1788813062.020697:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313253248:0@lo:400:kworker.0 00010000:00080000:0.0:1788813062.020708:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943698a80 x1875706313253760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813062.020717:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313253760:0@lo:400:kworker.0 00010000:00080000:0.0:1788813062.020727:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943698e00 x1875706313253632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813062.020735:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313253632:0@lo:400:kworker.0 00010000:00080000:0.0:1788813062.020743:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943533100 x1875706313254144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813062.020751:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313254144:0@lo:400:kworker.0 00000100:00080000:1.0:1788813062.023828:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813062.023838:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813062.529275:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813062.529331:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813062.529360:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813062.529590:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813062.529618:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813062.529674:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301659136 00000100:00100000:2.0:1788813062.529684:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301659136 00000100:00100000:2.0:1788813062.529735:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 292 00000100:00100000:2.0:1788813062.529745:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301659136:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813062.529827:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301659136:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 84us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813062.529834:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 292 00000100:00100000:2.0:1788813062.530019:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301659904 00000100:00100000:2.0:1788813062.530024:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301659904 00000100:00100000:2.0:1788813062.530062:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 45 00000100:00100000:2.0:1788813062.530069:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301659904:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813062.530103:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301659904:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 34us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813062.530110:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 45 00000100:00100000:0.0:1788813062.534961:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813062.536104:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301659392 00000100:00100000:1.0:1788813062.536117:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301659392 00000100:00100000:1.0:1788813062.536187:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301659648 00000100:00100000:1.0:1788813062.536191:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301659648 00000100:00100000:1.0:1788813062.536217:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301659264 00000100:00100000:1.0:1788813062.536220:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301659264 00000100:00100000:1.0:1788813062.536240:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 99 00000100:00100000:1.0:1788813062.536250:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301659392:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813062.539546:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301659392:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 3269us (10186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813062.539565:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 99 00000100:00100000:1.0:1788813062.539803:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 100 00000100:00100000:1.0:1788813062.539816:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301659648:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813062.539854:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301659648:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 43us (10493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813062.539861:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 100 00000100:00100000:1.0:1788813062.539873:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 101 00000100:00100000:1.0:1788813062.539881:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2398:x1875706301659264:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813062.539951:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2398:x1875706301659264:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 53us (10314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813062.539957:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 101 00000100:00080000:1.0:1788813062.539989:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813062.539994:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788813062.539999:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813062.540523:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813062.540955:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301659776 00000100:00100000:0.0:1788813062.540964:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301659776 00000100:00100000:0.0:1788813062.541016:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00100000:0.0:1788813062.541024:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301659776:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813062.541078:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301659776:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 55us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813062.541084:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00100000:0.0:1788813062.541274:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301659520 00000100:00100000:0.0:1788813062.541278:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301659520 00000100:00100000:0.0:1788813062.541306:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 102 00000100:00080000:1.0:1788813062.541751:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813062.541756:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813062.541816:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301659520:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813062.541853:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301659520:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 43us (6920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813062.541860:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 102 00010000:00010000:0.0:1788813063.016730:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813064.040489:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788813064.443532:0:12667:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813064.443757:0:12667:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788813065.060802:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813065.060961:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313254400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813065.061056:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813065.061202:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313254400 00000100:00100000:3.0:1788813065.061213:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313254400 00000100:00100000:3.0:1788813065.061282:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813065.061294:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313254400:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788813065.061469:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788813065.061642:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000024:3.0:1788813065.061993:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813065.062065:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313254400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 774us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813065.062074:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788813065.062632:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943533b80 x1875706313254400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813065.062656:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313254400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813065.064517:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a89c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313254272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813065.064603:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813065.075557:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313254272 00000100:00100000:0.0:1788813065.075577:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313254272 00000100:00100000:0.0:1788813065.076851:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788813065.076876:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313254272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788813065.076915:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813065.077048:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313254272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 185us (12443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813065.077070:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788813065.077647:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a6a89c700 x1875706313254272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813065.077686:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a89c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313254272:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788813065.091872:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788813066.084057:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813066.084201:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313254528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813066.084274:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813066.084414:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313254528 00000100:00100000:0.0:1788813066.084423:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313254528 00000100:00100000:0.0:1788813066.084481:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788813066.084491:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313254528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813066.084525:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788813066.084727:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313254528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 236us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813066.084735:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788813066.084800:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313254528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813066.596368:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813066.596398:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313254656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813066.596485:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813066.596721:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313254656 00000100:00100000:0.0:1788813066.596732:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313254656 00000100:00100000:0.0:1788813066.596828:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788813066.596839:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313254656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788813066.596894:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788813066.597003:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313254656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 166us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813066.597011:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788813066.597127:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313254656:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1788813066.760151:0:12765:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788813066.760393:0:12765:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788813067.108104:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813067.108134:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313254784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813067.108241:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813067.108613:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813067.108865:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313254784 00000100:00100000:3.0:1788813067.108876:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313254784 00000100:00100000:3.0:1788813067.108956:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788813067.108967:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313254784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788813067.109002:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813067.109058:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313254784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813067.109065:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788813067.109609:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788813067.109733:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccfbb80 x1875706313254784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813067.109758:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313254784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813067.109787:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313255168:0@lo:400:kworker.0 00000100:00100000:2.0:1788813067.109832:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813067.110103:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313255808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813067.110132:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813067.110153:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813067.110159:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313255296:0@lo:400:kworker.0 00000100:00100000:2.0:1788813067.110187:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813067.110219:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313255808 00000100:00100000:2.0:1788813067.110224:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313255808 00000100:00100000:2.0:1788813067.110272:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788813067.110280:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313255808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813067.110331:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813067.110370:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313255808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813067.110377:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788813067.110403:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313255296 00000100:00100000:2.0:1788813067.110406:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313255296 00000100:00100000:2.0:1788813067.110436:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788813067.110442:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313255296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813067.110476:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313255296:12345-0@lo:400:kworker.0 Request processed in 33us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813067.110482:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1788813067.110495:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813067.110522:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313255296:0@lo:400:kworker.0 00010000:00080000:2.0:1788813067.110534:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943641880 x1875706313255808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813067.110559:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313255808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813067.110608:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313254912:0@lo:400:kworker.0 00000100:00100000:2.0:1788813067.110640:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813067.110665:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313255424:0@lo:400:kworker.0 00000100:00100000:2.0:1788813067.110686:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813067.110798:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313255040:0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.110853:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813067.110886:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313255552:0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.110911:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813067.110928:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313256064:0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.110976:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813067.111001:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813067.111007:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313255936:0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.111028:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813067.111055:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313255040 00000100:00100000:3.0:1788813067.111060:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313255040 00000100:00100000:3.0:1788813067.111085:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313255552 00000100:00100000:3.0:1788813067.111088:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313255552 00000100:00100000:3.0:1788813067.111113:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788813067.111119:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313255040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.111157:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313255040:12345-0@lo:400:kworker.0 Request processed in 38us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813067.111163:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788813067.111178:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788813067.111184:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313255552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.111211:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313255552:12345-0@lo:400:kworker.0 Request processed in 28us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813067.111216:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788813067.111244:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313255040:0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.111251:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313255552:0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.111276:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313255680:0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.111298:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813067.111319:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313256320:0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.111338:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813067.111351:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813067.111355:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313256192:0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.111374:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813067.111391:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313255680 00000100:00100000:3.0:1788813067.111394:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313255680 00000100:00100000:3.0:1788813067.111409:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313256320 00000100:00100000:3.0:1788813067.111411:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313256320 00000100:00100000:3.0:1788813067.111420:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313256192 00000100:00100000:3.0:1788813067.111422:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313256192 00000100:00100000:3.0:1788813067.111434:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788813067.111438:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313255680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.111466:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313255680:12345-0@lo:400:kworker.0 Request processed in 27us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813067.111472:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788813067.111483:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788813067.111488:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313256320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.111514:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313256320:12345-0@lo:400:kworker.0 Request processed in 26us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813067.111520:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788813067.111531:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788813067.111537:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313256192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.111565:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313256192:12345-0@lo:400:kworker.0 Request processed in 29us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813067.111571:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788813067.111593:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313256192:0@lo:400:kworker.0 00010000:00080000:3.0:1788813067.111612:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e04700 x1875706313255680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813067.111621:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313255680:0@lo:400:kworker.0 00010000:00080000:3.0:1788813067.111631:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a6eb01c00 x1875706313256320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813067.111638:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313256320:0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.111683:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313256064 00000100:00100000:3.0:1788813067.111686:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313256064 00000100:00100000:3.0:1788813067.111714:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313255936 00000100:00100000:3.0:1788813067.111717:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313255936 00000100:00100000:3.0:1788813067.111735:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788813067.111742:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313256064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.111776:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313256064:12345-0@lo:400:kworker.0 Request processed in 35us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813067.111781:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788813067.111791:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813067.111797:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313255936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.111821:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313255936:12345-0@lo:400:kworker.0 Request processed in 25us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813067.111826:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813067.112922:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313254912 00000100:00100000:3.0:1788813067.112944:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313254912 00000100:00100000:3.0:1788813067.112995:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788813067.113002:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313254912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813067.113066:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313254912:12345-0@lo:400:kworker.0 Request processed in 64us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813067.113079:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00010000:00080000:3.0:1788813067.113155:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e06680 x1875706313255936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813067.113168:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313255936:0@lo:400:kworker.0 00010000:00080000:3.0:1788813067.113181:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e04e00 x1875706313256064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813067.113188:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313256064:0@lo:400:kworker.0 00000100:00080000:3.0:1788813067.113242:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813067.113247:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813067.113250:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813067.117210:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313254912:0@lo:400:kworker.0 00000100:00100000:1.0:1788813067.118402:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313255168 00000100:00100000:1.0:1788813067.118413:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313255168 00000100:00100000:0.0:1788813067.118979:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313255424 00000100:00100000:0.0:1788813067.118985:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313255424 00000100:00100000:0.0:1788813067.119029:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788813067.119041:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313255168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813067.119160:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313255168:12345-0@lo:400:kworker.0 Request processed in 121us (9326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813067.119168:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788813067.119187:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788813067.119201:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313255424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813067.119243:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313255424:12345-0@lo:400:kworker.0 Request processed in 43us (8555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813067.119249:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788813067.119299:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313255168:0@lo:400:kworker.0 00000100:00100000:0.0:1788813067.119353:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313255424:0@lo:400:kworker.0 00000100:00100000:2.0:1788813067.650516:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813067.650566:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813067.650596:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813067.650641:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813067.650662:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813067.650679:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813067.650699:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813067.650772:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301660672 00000100:00100000:3.0:1788813067.650785:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301660672 00000100:00100000:3.0:1788813067.650875:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301660800 00000100:00100000:3.0:1788813067.650879:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301660800 00000100:00100000:3.0:1788813067.650903:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:3.0:1788813067.650913:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2395:x1875706301660672:12345-192.168.202.13@tcp:9:kworker.0 00000020:00000080:3.0:1788813067.651089:0:8404:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702b14 00000100:00080000:3.0:1788813067.651105:0:8404:0:(import.c:65:import_set_state_nolock()) ffff948a7b794800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788813067.651162:0:8404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788813067.651957:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:811c25ff-4ab1-402b-924d-5308c16318af+2:2395:x1875706301660672:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 1016us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813067.651968:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:3.0:1788813067.651993:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:3.0:1788813067.652001:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2395:x1875706301660800:12345-192.168.202.13@tcp:9:kworker.0 00000020:00000080:3.0:1788813067.652019:0:8404:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702b1b 00000100:00080000:3.0:1788813067.652035:0:8404:0:(import.c:65:import_set_state_nolock()) ffff948943448000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788813067.652072:0:8404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788813067.652152:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:811c25ff-4ab1-402b-924d-5308c16318af+2:2395:x1875706301660800:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 152us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813067.652159:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:3.0:1788813067.652189:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301660160 00000100:00100000:3.0:1788813067.652194:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301660160 00000100:00100000:3.0:1788813067.652224:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301660416 00000100:00100000:3.0:1788813067.652227:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301660416 00000100:00100000:3.0:1788813067.652236:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301660288 00000100:00100000:3.0:1788813067.652239:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301660288 00000100:00100000:3.0:1788813067.652250:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301660544 00000100:00100000:3.0:1788813067.652252:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301660544 00000100:00100000:3.0:1788813067.652264:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 109 00000100:00100000:3.0:1788813067.652269:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2396:x1875706301660160:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813067.652295:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2396:x1875706301660160:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813067.652301:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 109 00000100:00100000:3.0:1788813067.652582:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 110 00000100:00100000:3.0:1788813067.652590:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301660416:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813067.652618:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301660416:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813067.652624:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 110 00000100:00100000:3.0:1788813067.652637:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 111 00000100:00100000:3.0:1788813067.652642:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301660288:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813067.652667:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301660288:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813067.652683:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 111 00000100:00100000:3.0:1788813067.652697:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 112 00000100:00100000:3.0:1788813067.652703:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301660544:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813067.652727:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301660544:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 25us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813067.652731:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 112 00010000:00010000:3.0:1788813067.652771:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813067.652778:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788813067.652970:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788813067.652975:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813067.652977:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813067.652980:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813067.653131:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301660032 00000100:00100000:0.0:1788813067.653136:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301660032 00000100:00100000:0.0:1788813067.653173:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 294 00000100:00100000:0.0:1788813067.653179:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:2397:x1875706301660032:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813067.653207:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:2397:x1875706301660032:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 28us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813067.653214:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 294 00010000:00010000:1.0:1788813068.153024:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788813069.087638:0:12862:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813069.087919:0:12862:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788813069.162619:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813070.181089:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313256448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813070.181183:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813070.181319:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813070.183920:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313256576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813070.184013:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813070.184081:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313256448 00000100:00100000:3.0:1788813070.184090:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313256448 00000100:00100000:3.0:1788813070.184153:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313256576 00000100:00100000:3.0:1788813070.184157:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313256576 00000100:00100000:3.0:1788813070.184175:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813070.184185:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313256448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788813070.184222:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813070.184270:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313256448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (3088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813070.184277:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813070.184299:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788813070.184305:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313256576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813070.184317:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813070.184358:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313256576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813070.184364:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788813070.184382:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788813070.184417:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e04e00 x1875706313256576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813070.184438:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313256576:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788813070.184604:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489434b6300 x1875706313256448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813070.184619:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313256448:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788813071.204093:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813071.204214:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813071.204245:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313256704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813071.204338:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813071.204423:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313256704 00000100:00100000:2.0:1788813071.204432:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313256704 00000100:00100000:2.0:1788813071.204492:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788813071.204518:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313256704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813071.204565:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788813071.204617:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313256704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813071.204625:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788813071.204681:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313256704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813071.717774:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813071.718100:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313256832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813071.718198:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813071.718326:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313256832 00000100:00100000:0.0:1788813071.718337:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313256832 00000100:00100000:0.0:1788813071.718394:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788813071.718405:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313256832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788813071.718450:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788813071.718581:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313256832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 177us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813071.718590:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788813071.720824:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313256832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813072.229130:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313256960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813072.229228:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813072.229344:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313256960 00000100:00100000:3.0:1788813072.229356:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313256960 00000100:00100000:3.0:1788813072.229424:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788813072.229435:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313256960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788813072.229474:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813072.229528:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313256960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813072.229535:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788813072.229561:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788813072.229601:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489434b6300 x1875706313256960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813072.229624:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313256960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813072.229873:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313257216:0@lo:400:kworker.0 00000100:00100000:2.0:1788813072.229918:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813072.229972:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313257728:0@lo:400:kworker.0 00000100:00100000:2.0:1788813072.229995:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813072.230011:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894349b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313258240:0@lo:400:kworker.0 00000100:00100000:2.0:1788813072.230033:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813072.230059:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788813072.230065:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313257344:0@lo:400:kworker.0 00000100:00100000:2.0:1788813072.230094:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813072.230115:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313257856:0@lo:400:kworker.0 00000100:00100000:2.0:1788813072.230138:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813072.230153:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943498e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313258368:0@lo:400:kworker.0 00000100:00100000:2.0:1788813072.230180:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813072.230209:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313257344 00000100:00100000:2.0:1788813072.230214:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313257344 00000100:00100000:2.0:1788813072.230251:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788813072.230259:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313257344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813072.230303:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313257344:12345-0@lo:400:kworker.0 Request processed in 45us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813072.230309:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788813072.230334:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313257472:0@lo:400:kworker.0 00000100:00100000:2.0:1788813072.230359:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813072.230371:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894349b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313257984:0@lo:400:kworker.0 00000100:00100000:2.0:1788813072.230395:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813072.230412:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313258496:0@lo:400:kworker.0 00000100:00100000:2.0:1788813072.230446:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813072.230463:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788813072.230468:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313257088:0@lo:400:kworker.0 00000100:00100000:2.0:1788813072.230499:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813072.230518:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313257600:0@lo:400:kworker.0 00000100:00100000:2.0:1788813072.230540:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813072.230556:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313258112:0@lo:400:kworker.0 00000100:00100000:2.0:1788813072.230576:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813072.230600:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313257600 00000100:00100000:2.0:1788813072.230604:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313257600 00000100:00100000:2.0:1788813072.230631:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788813072.230638:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313257600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813072.230674:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313257600:12345-0@lo:400:kworker.0 Request processed in 36us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813072.230682:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788813072.230711:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313257344:0@lo:400:kworker.0 00000100:00100000:2.0:1788813072.230736:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313257600:0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.231050:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313257216 00000100:00100000:3.0:1788813072.231055:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313257216 00000100:00100000:3.0:1788813072.231078:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313257728 00000100:00100000:3.0:1788813072.231080:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313257728 00000100:00100000:3.0:1788813072.231102:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313258240 00000100:00100000:3.0:1788813072.231105:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313258240 00000100:00100000:3.0:1788813072.231126:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313257856 00000100:00100000:3.0:1788813072.231128:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313257856 00000100:00100000:3.0:1788813072.231139:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313258368 00000100:00100000:3.0:1788813072.231141:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313258368 00000100:00100000:3.0:1788813072.231150:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313257472 00000100:00100000:3.0:1788813072.231152:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313257472 00000100:00100000:3.0:1788813072.231163:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788813072.231169:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313257216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.231208:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313257216:12345-0@lo:400:kworker.0 Request processed in 40us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813072.231214:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788813072.231225:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788813072.231230:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313257728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.231254:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313257728:12345-0@lo:400:kworker.0 Request processed in 24us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813072.231260:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788813072.231272:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788813072.231278:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313258240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.231302:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313258240:12345-0@lo:400:kworker.0 Request processed in 25us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813072.231307:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788813072.231317:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788813072.231321:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313257856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.231344:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313257856:12345-0@lo:400:kworker.0 Request processed in 23us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813072.231349:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788813072.231357:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788813072.231369:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313258368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.231394:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313258368:12345-0@lo:400:kworker.0 Request processed in 26us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813072.231399:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788813072.231410:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788813072.231415:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313257472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.231441:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313257472:12345-0@lo:400:kworker.0 Request processed in 26us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813072.231446:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788813072.231476:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313257984 00000100:00100000:3.0:1788813072.231479:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313257984 00000100:00100000:3.0:1788813072.231500:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313258496 00000100:00100000:3.0:1788813072.231503:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313258496 00000100:00100000:3.0:1788813072.231515:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313258112 00000100:00100000:3.0:1788813072.231517:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313258112 00000100:00100000:3.0:1788813072.231526:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788813072.231532:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313257984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.231560:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313257984:12345-0@lo:400:kworker.0 Request processed in 28us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813072.231565:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788813072.231574:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788813072.231580:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313258496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.231620:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313258496:12345-0@lo:400:kworker.0 Request processed in 40us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813072.231626:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788813072.231636:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788813072.231641:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313258112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.231671:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313258112:12345-0@lo:400:kworker.0 Request processed in 30us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813072.231677:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788813072.231700:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313257088 00000100:00100000:3.0:1788813072.231703:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313257088 00000100:00100000:3.0:1788813072.231728:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788813072.231734:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313257088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.231761:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313257088:12345-0@lo:400:kworker.0 Request processed in 27us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813072.231766:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:2.0:1788813072.232046:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813072.232051:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813072.232054:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788813072.232056:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788813072.232268:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccfbb80 x1875706313257856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813072.232282:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313257856:0@lo:400:kworker.0 00010000:00080000:3.0:1788813072.232293:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943498e00 x1875706313258368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813072.232302:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943498e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313258368:0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.232314:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313257216:0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.232324:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313257728:0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.232333:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894349b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313258240:0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.232369:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313257088:0@lo:400:kworker.0 00010000:00080000:3.0:1788813072.232380:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943499880 x1875706313258112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813072.232402:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313258112:0@lo:400:kworker.0 00000100:00100000:3.0:1788813072.232414:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313257472:0@lo:400:kworker.0 00010000:00080000:3.0:1788813072.232424:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894349b800 x1875706313257984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813072.232431:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894349b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313257984:0@lo:400:kworker.0 00010000:00080000:3.0:1788813072.232441:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943498a80 x1875706313258496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813072.232449:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313258496:0@lo:400:kworker.0 00000100:00100000:1.0:1788813072.236069:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813072.236096:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313258624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813072.236180:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813072.236238:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313258624 00000100:00100000:1.0:1788813072.236248:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313258624 00000100:00100000:1.0:1788813072.236300:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788813072.236309:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943641880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313258624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813072.236337:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813072.236384:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943641880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313258624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813072.236404:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788813072.236454:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943643480 x1875706313258624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813072.236475:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313258624:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788813072.246495:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788813072.749143:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 811c25ff-4ab1-402b-924d-5308c16318af 00000020:00000080:3.0:1788813072.749153:0:9483:0:(genops.c:885:class_export_put()) final put ffff94894344b000/811c25ff-4ab1-402b-924d-5308c16318af 00000020:00000080:2.0:1788813072.749281:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94894344b000/811c25ff-4ab1-402b-924d-5308c16318af for lustre-OST0001 00000020:00000080:2.0:1788813072.749335:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948943448000 for lustre-OST0001 00000001:00100000:2.0:1788813072.759586:0:8399:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 811c25ff-4ab1-402b-924d-5308c16318af 00000020:00000080:2.0:1788813072.759598:0:8399:0:(genops.c:885:class_export_put()) final put ffff948a7b792800/811c25ff-4ab1-402b-924d-5308c16318af 00000020:00000080:3.0:1788813072.759691:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b792800/811c25ff-4ab1-402b-924d-5308c16318af for lustre-OST0000 00000020:00000080:3.0:1788813072.759737:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a7b794800 for lustre-OST0000 00000100:00100000:0.0:1788813072.774108:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813072.774147:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813072.774188:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813072.774277:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301660928 00000100:00100000:3.0:1788813072.774287:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301660928 00000100:00100000:3.0:1788813072.774333:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 296 00000100:00100000:3.0:1788813072.774342:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2399:x1875706301660928:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813072.774403:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2399:x1875706301660928:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 62us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813072.774410:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 296 00000100:00100000:0.0:1788813072.774616:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813072.780519:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813072.781853:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301661184 00000100:00100000:2.0:1788813072.781865:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301661184 00000100:00100000:2.0:1788813072.782418:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301661440 00000100:00100000:2.0:1788813072.782424:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301661440 00000100:00100000:2.0:1788813072.782441:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301661056 00000100:00100000:2.0:1788813072.782444:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301661056 00000100:00100000:2.0:1788813072.782463:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 119 00000100:00100000:2.0:1788813072.782472:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301661184:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813072.785374:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301661184:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 2899us (11222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813072.785383:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 119 00000100:00100000:2.0:1788813072.785415:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 120 00000100:00100000:2.0:1788813072.785425:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301661440:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813072.785467:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301661440:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 46us (11278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813072.785474:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 120 00000100:00100000:2.0:1788813072.785486:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 121 00000100:00100000:2.0:1788813072.785493:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2399:x1875706301661056:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813072.785512:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2399:x1875706301661056:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 20us (10897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813072.785517:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 121 00000100:00080000:2.0:1788813072.785537:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813072.785541:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788813072.786694:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301661312 00000100:00100000:1.0:1788813072.786703:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301661312 00000100:00100000:1.0:1788813072.786758:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 122 00000100:00100000:1.0:1788813072.786766:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301661312:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813072.786822:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301661312:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 56us (6314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813072.786828:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 122 00000100:00080000:0.0:1788813072.786891:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788813073.252144:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788813073.668875:0:13007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788813074.276132:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813075.307705:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813075.425824:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813075.425851:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313258752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813075.425953:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813075.426022:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313258752 00000100:00100000:1.0:1788813075.426030:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313258752 00000100:00100000:1.0:1788813075.426085:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788813075.426095:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313258752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788813075.426126:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813075.426172:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313258752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813075.426178:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788813075.426241:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943643480 x1875706313258752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813075.426261:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313258752:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788813075.426752:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813075.673251:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813075.675682:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894349b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313258880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813075.675757:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813075.677909:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313258880 00000100:00100000:0.0:1788813075.677922:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313258880 00000100:00100000:0.0:1788813075.678372:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813075.678381:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313258880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813075.678407:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813075.678469:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313258880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (2712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813075.678475:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788813075.678519:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894349b100 x1875706313258880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813075.678536:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894349b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313258880:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788813075.679344:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813076.324225:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894349b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313259008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813076.324294:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813076.324531:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313259008 00000100:00100000:2.0:1788813076.324539:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313259008 00000100:00100000:2.0:1788813076.324588:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788813076.324598:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313259008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813076.324632:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788813076.324689:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313259008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813076.324697:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788813076.324981:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894349b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313259008:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788813076.325443:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813076.837191:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313259136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813076.837277:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813076.837400:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313259136 00000100:00100000:2.0:1788813076.837408:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313259136 00000100:00100000:2.0:1788813076.837462:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788813076.837471:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313259136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788813076.837505:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788813076.842401:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313259136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4918us (5111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813076.842417:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788813076.846342:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313259136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813077.348133:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813077.348157:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313259264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813077.348225:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813077.348318:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313259264 00000100:00100000:1.0:1788813077.348327:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313259264 00000100:00100000:1.0:1788813077.348385:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788813077.348396:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313259264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788813077.348426:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813077.348488:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313259264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813077.348495:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788813077.348515:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788813077.348540:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e06d80 x1875706313259264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813077.348559:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313259264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813077.348883:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813077.348895:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313259392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813077.348926:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813077.348985:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313259392 00000100:00100000:0.0:1788813077.348990:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313259392 00000100:00100000:0.0:1788813077.349024:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788813077.349030:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313259392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813077.349043:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813077.349074:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313259392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813077.349093:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788813077.349110:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788813077.349150:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788813077.349171:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e06d80 x1875706313259392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813077.349185:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313259392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813077.357206:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313259520:0@lo:400:kworker.0 00000100:00100000:2.0:1788813077.357294:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813077.357384:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313259520 00000100:00100000:3.0:1788813077.357392:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313259520 00000100:00100000:3.0:1788813077.357439:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788813077.357463:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313259520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813077.359989:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313259648:0@lo:400:kworker.0 00000100:00100000:1.0:1788813077.360061:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813077.365660:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313259520:12345-0@lo:400:kworker.0 Request processed in 8187us (8354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813077.365676:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788813077.367037:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313259648 00000100:00100000:3.0:1788813077.367050:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313259648 00000100:00100000:3.0:1788813077.367137:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788813077.367148:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313259648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813077.367229:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313259648:12345-0@lo:400:kworker.0 Request processed in 83us (7167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813077.367589:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788813077.367673:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313259520:0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.368815:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313259776:0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.368868:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813077.368917:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313259776 00000100:00100000:0.0:1788813077.368922:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313259776 00000100:00100000:0.0:1788813077.368983:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788813077.368990:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313259776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.369033:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313259776:12345-0@lo:400:kworker.0 Request processed in 43us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813077.369040:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788813077.369102:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313259776:0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.369132:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313259904:0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.369159:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813077.377879:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313260288:0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.377957:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813077.378039:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313260032:0@lo:400:kworker.0 00000100:00100000:2.0:1788813077.378070:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813077.378098:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313260032 00000100:00100000:2.0:1788813077.378106:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313260032 00000100:00100000:2.0:1788813077.378154:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788813077.378163:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313260032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813077.378226:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313260032:12345-0@lo:400:kworker.0 Request processed in 63us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813077.378246:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788813077.378291:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313260032:0@lo:400:kworker.0 00000100:00100000:2.0:1788813077.378306:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813077.378311:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313260160:0@lo:400:kworker.0 00000100:00100000:1.0:1788813077.380671:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313259904 00000100:00100000:1.0:1788813077.380708:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313259904 00000100:00100000:1.0:1788813077.380956:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313259648:0@lo:400:kworker.0 00000100:00100000:1.0:1788813077.381030:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788813077.381039:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313259904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813077.381116:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313259904:12345-0@lo:400:kworker.0 Request processed in 78us (11956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813077.381123:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788813077.382339:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313260672:0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.382987:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313260800:0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.383021:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813077.383043:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813077.383048:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313260416:0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.383089:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813077.383142:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313259904:0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.383166:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313260288 00000100:00100000:0.0:1788813077.383172:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313260288 00000100:00100000:0.0:1788813077.383216:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313260800 00000100:00100000:0.0:1788813077.383219:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313260800 00000100:00100000:2.0:1788813077.383554:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813077.384904:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313260160 00000100:00100000:0.0:1788813077.384914:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313260160 00000100:00100000:0.0:1788813077.384966:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788813077.384976:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313260288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.385044:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313260288:12345-0@lo:400:kworker.0 Request processed in 71us (7088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813077.385051:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788813077.385068:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788813077.385075:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313260800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.385103:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313260800:12345-0@lo:400:kworker.0 Request processed in 29us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813077.385109:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788813077.385120:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788813077.385126:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313260160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.385152:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313260160:12345-0@lo:400:kworker.0 Request processed in 27us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813077.385157:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788813077.385176:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313260416 00000100:00100000:0.0:1788813077.385180:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313260416 00000100:00100000:0.0:1788813077.385208:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788813077.385215:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313260416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.385275:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313260416:12345-0@lo:400:kworker.0 Request processed in 61us (2185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813077.385281:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788813077.385300:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813077.385305:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813077.385307:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788813077.385350:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943642300 x1875706313260416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813077.385364:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313260416:0@lo:400:kworker.0 00010000:00080000:0.0:1788813077.385376:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489434e7100 x1875706313260800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813077.385385:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313260800:0@lo:400:kworker.0 00010000:00080000:0.0:1788813077.385395:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943423b80 x1875706313260288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813077.385402:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313260288:0@lo:400:kworker.0 00000100:00100000:2.0:1788813077.391913:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813077.392002:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788813077.392015:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313260544:0@lo:400:kworker.0 00000100:00100000:2.0:1788813077.392072:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813077.392109:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313260544 00000100:00100000:2.0:1788813077.392118:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313260544 00000100:00100000:2.0:1788813077.392172:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788813077.392182:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313260544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.392309:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313260672 00000100:00100000:0.0:1788813077.392315:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313260672 00000100:00100000:0.0:1788813077.392344:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788813077.392350:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313260672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813077.392410:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313260672:12345-0@lo:400:kworker.0 Request processed in 59us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813077.392417:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788813077.393419:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313260544:12345-0@lo:400:kworker.0 Request processed in 1235us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813077.393429:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788813077.393493:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943640000 x1875706313260544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813077.393507:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313260544:0@lo:400:kworker.0 00000100:00100000:2.0:1788813077.393520:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313260672:0@lo:400:kworker.0 00000100:00080000:2.0:1788813077.393549:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813077.393555:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813077.393579:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313260160:0@lo:400:kworker.0 00000020:00000080:3.0:1788813077.613151:0:13154:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb20fe050 20000000:00000080:3.0:1788813077.613173:0:13154:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff948943415000 uarg=0000000000000000 20000000:01000000:3.0:1788813077.613215:0:13154:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788813077.613221:0:13154:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788813077.613226:0:13154:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788813077.614206:0:13155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788813077.614356:0:13154:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788813077.622155:0:13154:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788813077.622190:0:13154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948943656e00/0xf32533d6ff702b22 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.622214:0:13154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f8600/0xf32533d6ff702a34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07295d9 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.622368:0:13154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702a57 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.622376:0:13154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702a88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702a81 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.623391:0:13154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702ab2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702aab expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.623406:0:13154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a4151da00/0xf32533d6ff702adc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702ad5 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.623414:0:13154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff702aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729618 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.623422:0:13154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948943656e00/0xf32533d6ff702b22 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.623483:0:13154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff702aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729618 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.623499:0:13154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff702aff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729618 expref: 12 pid: 6487 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813077.623515:0:13154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875706313260928:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813077.623626:0:13154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a4151da00/0xf32533d6ff702adc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702ad5 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.623634:0:13154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a4151da00/0xf32533d6ff702adc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702ad5 expref: 23 pid: 6487 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813077.623656:0:13154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875706313261056:0@lo:104: 00000100:00100000:3.0:1788813077.623702:0:13154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813077.623821:0:13154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702aab expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.623831:0:13154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702ab2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702aab expref: 23 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813077.623839:0:13154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875706313261184:0@lo:104: 00000100:00100000:3.0:1788813077.623862:0:13154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813077.623883:0:13154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702a88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702a81 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.623892:0:13154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702a88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702a81 expref: 23 pid: 6488 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813077.623900:0:13154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb01c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875706313261312:0@lo:104: 00000100:00100000:3.0:1788813077.623920:0:13154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813077.623975:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313261056 00000100:00100000:3.0:1788813077.623983:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313261056 00000100:00100000:3.0:1788813077.624022:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313261184 00000100:00100000:3.0:1788813077.624025:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313261184 00000100:00100000:3.0:1788813077.624035:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313261312 00000100:00100000:3.0:1788813077.624037:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313261312 00000100:00100000:3.0:1788813077.624048:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788813077.624493:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+5:13154:x1875706313261056:12345-0@lo:104: 00010000:00010000:3.0:1788813077.624508:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff702ad5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702adc expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813077.624784:0:10309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788813077.624797:0:10309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+5:13154:x1875706313261184:12345-0@lo:104: 00010000:00010000:1.0:1788813077.624807:0:10309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9400/0xf32533d6ff702aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702ab2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.624856:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788813077.624862:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+5:13154:x1875706313261056:12345-0@lo:104: Request processed in 807us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813077.624869:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788813077.624892:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788813077.624899:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:13154:x1875706313261312:12345-0@lo:104: 00010000:00010000:3.0:1788813077.624907:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a6fc08e00/0xf32533d6ff702a81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702a88 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813077.628821:0:13154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702a57 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813077.628841:0:13154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702a57 expref: 23 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813077.628857:0:13154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943498e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875706313261440:0@lo:104: 00000100:00100000:2.0:1788813077.628915:0:13154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813077.628963:0:13154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f8600/0xf32533d6ff702a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07295d9 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813077.628972:0:13154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a7b5f8600/0xf32533d6ff702a34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07295d9 expref: 12 pid: 6487 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813077.628980:0:13154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875706313261568:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813077.629048:0:13154:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813077.629582:0:13154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875706313261056:0@lo:104: 00000100:00100000:2.0:1788813077.629592:0:13154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875706313261184:0@lo:104: 00000100:00100000:2.0:1788813077.629598:0:13154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb01c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875706313261312:0@lo:104: 00010000:00010000:0.0:1788813077.629703:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788813077.629776:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff702ad5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702adc expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.629799:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4151dc00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813077.629803:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff702ad5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702adc expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.629813:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff702ad5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702adc expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813077.629821:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff702ad5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702adc expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813077.629827:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788813077.633217:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff702ad5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702adc expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.633301:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788813077.633351:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313261696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813077.633413:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813077.633512:0:10309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813077.633523:0:10309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:13154:x1875706313261184:12345-0@lo:104: Request processed in 8729us (9658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813077.633533:0:10309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788813077.633564:0:10309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313261440 00000100:00100000:1.0:1788813077.633571:0:10309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313261440 00000100:00100000:1.0:1788813077.633601:0:10309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788813077.633609:0:10309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:13154:x1875706313261440:12345-0@lo:104: 00010000:00010000:1.0:1788813077.633619:0:10309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702a57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702a5e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.633672:0:10309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788813077.633677:0:10309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:13154:x1875706313261440:12345-0@lo:104: Request processed in 70us (4762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813077.633683:0:10309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788813077.633788:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff702ad5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702adc expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.633797:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4151dc00/0xf32533d6ff702ad5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702adc expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813077.633820:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313261696 00000100:00100000:0.0:1788813077.633824:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313261696 00010000:00010000:0.0:1788813077.633846:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a4151da00/0xf32533d6ff702adc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702ad5 expref: 24 pid: 6487 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813077.633869:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788813077.633876:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313261696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813077.633886:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813077.633898:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a4151da00/0xf32533d6ff702adc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702ad5 expref: 24 pid: 6487 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.633907:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a4151da00/0xf32533d6ff702adc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702ad5 expref: 24 pid: 6487 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.633953:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a4151da00/0xf32533d6ff702adc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702ad5 expref: 24 pid: 6487 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.633965:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813077.635357:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788813077.635371:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9400/0xf32533d6ff702aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702ab2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.635381:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9400 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813077.635385:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9400/0xf32533d6ff702aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702ab2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.635395:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9400/0xf32533d6ff702aab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702ab2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813077.635402:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9400/0xf32533d6ff702aab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702ab2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813077.635409:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813077.635468:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9400/0xf32533d6ff702aab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702ab2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.635474:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813077.635497:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9400/0xf32533d6ff702aab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702ab2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.635503:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9400/0xf32533d6ff702aab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702ab2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.635517:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813077.635521:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a6fc08e00/0xf32533d6ff702a81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702a88 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.635527:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813077.635530:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc08e00/0xf32533d6ff702a81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702a88 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.635548:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a6fc08e00/0xf32533d6ff702a81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702a88 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813077.635553:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc08e00/0xf32533d6ff702a81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702a88 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813077.635558:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813077.635574:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a6fc08e00/0xf32533d6ff702a81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702a88 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.635579:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813077.635585:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a6fc08e00/0xf32533d6ff702a81 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702a88 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.635591:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a6fc08e00/0xf32533d6ff702a81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702a88 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.635601:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813077.635604:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702a57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702a5e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.635610:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09600 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813077.635612:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702a57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702a5e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.635619:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702a57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702a5e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813077.635624:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702a57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702a5e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813077.635636:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813077.635651:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702a57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702a5e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.635656:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813077.635794:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788813077.635807:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:13154:x1875706313261312:12345-0@lo:104: Request processed in 10905us (11882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813077.635818:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788813077.636069:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813077.636132:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813077.636156:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301661568 00000100:00100000:3.0:1788813077.636162:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301661568 00010000:00010000:3.0:1788813077.636186:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff702aff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729618 expref: 13 pid: 6487 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813077.636207:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301661696 00000100:00100000:3.0:1788813077.636210:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301661696 00010000:00010000:3.0:1788813077.636221:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f8600/0xf32533d6ff702a34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07295d9 expref: 14 pid: 6487 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813077.636245:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 41 00000100:00100000:3.0:1788813077.636254:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:612bc516-9aee-451d-b7c0-359fff7db073+14:2396:x1875706301661568:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813077.636275:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813077.636281:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff702aff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729618 expref: 14 pid: 6487 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.636292:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff702aff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729618 expref: 14 pid: 6487 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.636308:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813077.636355:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:612bc516-9aee-451d-b7c0-359fff7db073+14:2396:x1875706301661568:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 102us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813077.636361:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 41 00000100:00100000:3.0:1788813077.636376:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 42 00000100:00100000:3.0:1788813077.636382:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943526300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:612bc516-9aee-451d-b7c0-359fff7db073+13:2396:x1875706301661696:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813077.636390:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813077.636394:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f8600/0xf32533d6ff702a34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07295d9 expref: 13 pid: 6487 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.636402:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f8600/0xf32533d6ff702a34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07295d9 expref: 13 pid: 6487 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.636411:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813077.636429:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943526300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:612bc516-9aee-451d-b7c0-359fff7db073+13:2396:x1875706301661696:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 47us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813077.636435:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 42 00010000:00010000:3.0:1788813077.638017:0:13154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff702aff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729618 expref: 12 pid: 6487 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813077.638050:0:13154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875706313260928:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813077.638091:0:13154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943498e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875706313261440:0@lo:104: 00010000:00010000:3.0:1788813077.638101:0:13154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8600/0xf32533d6ff702a34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07295d9 expref: 11 pid: 6487 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813077.638111:0:13154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13154:1875706313261568:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813077.638143:0:13154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948943656e00/0xf32533d6ff702b22 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813077.638531:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:3626:x1875706313261696:12345-0@lo:103:ldlm_bl.0 Request processed in 4653us (5116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813077.638541:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788813077.638580:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313262080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813077.638632:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813077.638689:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313262080 00000100:00100000:0.0:1788813077.638695:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313262080 00010000:00010000:0.0:1788813077.638734:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702a57 expref: 23 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813077.638771:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813077.638779:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943420a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:3625:x1875706313262080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813077.638791:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813077.638796:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702a57 expref: 23 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.638806:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702a57 expref: 23 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.638822:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f9a00/0xf32533d6ff702a5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702a57 expref: 23 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.638844:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813077.638875:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943420a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:3625:x1875706313262080:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813077.638882:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813077.638920:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313262080:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813077.638955:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813077.638959:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813077.638960:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813077.638980:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813077.639103:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313261952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813077.639128:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813077.639147:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813077.639152:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313261824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813077.639172:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813077.639195:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313261952 00000100:00100000:0.0:1788813077.639199:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313261952 00010000:00010000:0.0:1788813077.639212:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702a88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702a81 expref: 22 pid: 6488 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813077.639227:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313261824 00000100:00100000:0.0:1788813077.639229:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313261824 00010000:00010000:0.0:1788813077.639251:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702ab2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702aab expref: 23 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813077.639263:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788813077.639268:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:3628:x1875706313261952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813077.639275:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813077.639286:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702a88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702a81 expref: 23 pid: 6488 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.639294:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702a88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702a81 expref: 23 pid: 6488 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.639303:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc08200/0xf32533d6ff702a88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702a81 expref: 23 pid: 6488 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.639312:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813077.639339:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:3628:x1875706313261952:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813077.639345:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788813077.639357:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788813077.639362:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50685c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:3628:x1875706313261824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813077.639368:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813077.639372:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702ab2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702aab expref: 21 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.639380:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702aab expref: 21 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.639389:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff702ab2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702aab expref: 21 pid: 6486 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.639399:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948943656e00/0xf32533d6ff702b22 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.639407:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948943656e00/0xf32533d6ff702b22 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.639430:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948943656e00/0xf32533d6ff702b22 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.639438:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948943656e00/0xf32533d6ff702b22 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.639445:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948943656e00/0xf32533d6ff702b22 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.639451:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948943656e00/0xf32533d6ff702b22 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.639457:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813077.639461:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948943656e00/0xf32533d6ff702b22 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.639470:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948943656e00/0xf32533d6ff702b22 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.639482:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948943656e00/0xf32533d6ff702b22 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813077.639491:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813077.639511:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50685c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:3628:x1875706313261824:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813077.639517:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788813077.639560:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313261824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813077.639568:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313261952:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813077.640076:0:13154:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948943656e00/0xf32533d6ff702b22 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.640085:0:13154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948943656e00/0xf32533d6ff702b22 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813077.640091:0:13154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948943656e00/0xf32533d6ff702b22 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813077.643125:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313261696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813077.648044:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702a57 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702a5e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.648078:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702a57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702a5e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813077.648102:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813077.648104:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813077.648106:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813077.892768:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813077.892824:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813077.892856:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813077.892880:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301661952 00000100:00100000:2.0:1788813077.892890:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301661952 00000100:00100000:0.0:1788813077.892897:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813077.892968:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301662208 00000100:00100000:2.0:1788813077.892972:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301662208 00000100:00100000:1.0:1788813077.892979:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301661824 00000100:00100000:1.0:1788813077.892983:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301661824 00000100:00100000:2.0:1788813077.892985:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301662080 00000100:00100000:2.0:1788813077.893006:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301662080 00000100:00100000:1.0:1788813077.893007:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 129 00000100:00100000:1.0:1788813077.893016:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301661952:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813077.893022:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 130 00000100:00100000:2.0:1788813077.893027:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301662208:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813077.893082:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301662208:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 54us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813077.893089:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 130 00000100:00100000:2.0:1788813077.893107:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 131 00000100:00100000:2.0:1788813077.893113:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2399:x1875706301661824:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813077.893363:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301661952:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 347us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813077.893371:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 129 00000100:00100000:1.0:1788813077.893385:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 132 00000100:00100000:1.0:1788813077.893392:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301662080:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813077.893433:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301662080:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 41us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813077.893440:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 132 00000100:00100000:2.0:1788813077.893457:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2399:x1875706301661824:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 343us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813077.893463:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 131 00000100:00080000:2.0:1788813077.893479:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813077.893482:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788813078.373647:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813078.932419:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813078.937777:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301662336 00000100:00100000:3.0:1788813078.937794:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301662336 00000100:00100000:3.0:1788813078.938087:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 298 00000100:00100000:3.0:1788813078.938099:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+11:6158:x1875706301662336:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813078.938117:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813078.938138:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948943656c00/0xf32533d6ff702b29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729649 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813078.938167:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948943656c00/0xf32533d6ff702b29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729649 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813078.938178:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948943656c00/0xf32533d6ff702b29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729649 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813078.938197:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656c00, rc 0) 00000100:00100000:3.0:1788813078.938262:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+12:6158:x1875706301662336:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 Request processed in 165us (5855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813078.938269:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 298 00000100:00100000:3.0:1788813078.957017:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813078.957054:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301662464 00000100:00100000:3.0:1788813078.957065:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301662464 00000100:00100000:3.0:1788813078.957114:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 299 00000100:00100000:3.0:1788813078.957124:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+12:6158:x1875706301662464:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813078.957272:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+12:6158:x1875706301662464:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 Request processed in 149us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813078.957280:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 299 00000100:00100000:3.0:1788813078.968361:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813078.968401:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301662592 00000100:00100000:3.0:1788813078.968409:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301662592 00000100:00100000:3.0:1788813078.968461:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 300 00000100:00100000:3.0:1788813078.968472:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+12:6158:x1875706301662592:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813078.968594:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+12:6158:x1875706301662592:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 Request processed in 124us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813078.968602:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 300 00000100:00100000:3.0:1788813078.983276:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813078.983814:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301662720 00000100:00100000:0.0:1788813078.983825:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301662720 00000100:00100000:0.0:1788813078.983896:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 301 00000100:00100000:0.0:1788813078.983906:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+12:6158:x1875706301662720:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813078.983923:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813078.983959:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cdac00/0xf32533d6ff702b30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729650 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813078.984000:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdac00/0xf32533d6ff702b30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729650 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813078.984013:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cdac00/0xf32533d6ff702b30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729650 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813078.984022:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdac00, rc 0) 00000100:00100000:0.0:1788813078.984100:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:6158:x1875706301662720:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 Request processed in 195us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813078.984107:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 301 00000100:00100000:3.0:1788813078.988390:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813078.991164:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301662848 00000100:00100000:0.0:1788813078.991181:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301662848 00000100:00100000:0.0:1788813078.991375:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 302 00000100:00100000:0.0:1788813078.991797:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:6158:x1875706301662848:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813078.994958:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:6158:x1875706301662848:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 Request processed in 3142us (6553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813078.996916:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 302 00000100:00100000:1.0:1788813078.997173:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813078.998110:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301662976 00000100:00100000:0.0:1788813078.998478:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301662976 00000100:00100000:0.0:1788813078.998530:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 303 00000100:00100000:0.0:1788813078.998540:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:6158:x1875706301662976:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813079.000847:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:6158:x1875706301662976:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 Request processed in 2293us (3660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813079.000874:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 303 10000000:01000000:0.0:1788813079.014304:0:6492:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788813079.014312:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a7b522000 from 7 10000000:01000000:0.0:1788813079.014317:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813079.014367:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff702b37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813079.014381:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff702b37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813079.014392:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff702b37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813079.014418:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943423100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313262208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813079.014501:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813079.014547:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436136c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813079.016759:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313262208 00000100:00100000:1.0:1788813079.016776:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313262208 00000100:00100000:1.0:1788813079.016848:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788813079.016858:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313262208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813079.016876:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813079.016896:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff702b3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702b37 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813079.016922:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff702b3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702b37 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813079.016958:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff702b3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702b37 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813079.016967:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9400, rc 0) 00000100:00100000:1.0:1788813079.017343:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313262208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 486us (2841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813079.017350:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788813079.019213:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943423100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313262208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813079.019241:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff702b37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702b3e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813079.019252:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff702b37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702b3e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813079.019328:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943423100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313262336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813079.019387:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813079.019430:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436136c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813079.020018:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313262336 00000100:00100000:2.0:1788813079.020025:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313262336 00000100:00100000:2.0:1788813079.020085:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788813079.020098:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313262336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813079.020268:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313262336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813079.020278:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788813079.021975:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943423100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313262336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813079.022028:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943423100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313262464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813079.022083:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813079.022112:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436136c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813079.022202:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313262464 00000100:00100000:3.0:1788813079.022208:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313262464 00000100:00100000:3.0:1788813079.022264:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788813079.022271:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313262464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813079.022360:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313262464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813079.022367:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788813079.023001:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943423100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313262464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788813079.028145:0:13183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788813079.028365:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788813079.028388:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813079.028399:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff702b37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702b3e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813079.028411:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff702b37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702b3e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813079.028421:0:6492:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788813079.028424:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a7b74e800 from 7 10000000:01000000:0.0:1788813079.028427:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813079.028466:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff702b45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813079.028486:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff702b45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813079.028497:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff702b45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813079.028523:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943423100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313262592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813079.028600:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813079.028649:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436136c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813079.028783:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313262592 00000100:00100000:3.0:1788813079.028791:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313262592 00000100:00100000:3.0:1788813079.028848:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788813079.028857:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313262592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813079.028871:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813079.028884:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948943656e00/0xf32533d6ff702b4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702b45 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813079.028909:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948943656e00/0xf32533d6ff702b4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702b45 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813079.028919:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948943656e00/0xf32533d6ff702b4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702b45 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813079.028927:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656e00, rc 0) 00000100:00100000:3.0:1788813079.028990:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313262592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813079.028996:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788813079.029180:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943423100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313262592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813079.029194:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff702b45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702b4c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813079.029203:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff702b45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702b4c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813079.029605:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313262720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813079.029635:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813079.029663:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813079.029740:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313262720 00000100:00100000:0.0:1788813079.029745:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313262720 00000100:00100000:0.0:1788813079.029781:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788813079.029789:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313262720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813079.029903:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313262720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813079.029910:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788813079.030014:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313262720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813079.030063:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313262848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813079.030102:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813079.030117:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813079.030323:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313262848 00000100:00100000:0.0:1788813079.030328:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313262848 00000100:00100000:0.0:1788813079.030360:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788813079.030367:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313262848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813079.030469:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313262848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813079.030475:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788813079.033684:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313262848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788813079.035216:0:13184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788813079.035580:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788813079.035604:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788813079.035614:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff702b45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702b4c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813079.035625:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff702b45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702b4c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813079.035635:0:6492:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788813079.035638:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a61047800 from 7 10000000:01000000:3.0:1788813079.035640:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788813079.035677:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657400/0xf32533d6ff702b53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813079.035685:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948943657400/0xf32533d6ff702b53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813079.035767:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948943657400/0xf32533d6ff702b53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813079.035792:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313262976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813079.043825:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813079.044091:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256300 going to sleep for 11 seconds 00000100:00100000:2.0:1788813079.045581:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313262976 00000100:00100000:2.0:1788813079.045593:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313262976 00000100:00100000:3.0:1788813079.050178:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788813079.050192:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313262976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813079.050222:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813079.050241:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948943657600/0xf32533d6ff702b5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702b53 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813079.050271:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948943657600/0xf32533d6ff702b5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702b53 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813079.050281:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948943657600/0xf32533d6ff702b5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702b53 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813079.050290:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657600, rc 0) 00000100:00100000:3.0:1788813079.050365:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313262976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (6549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813079.050371:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788813079.054180:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313262976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813079.054223:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948943657400/0xf32533d6ff702b53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702b5a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813079.054237:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948943657400/0xf32533d6ff702b53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702b5a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813079.054323:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313263104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813079.054387:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813079.054445:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256300 going to sleep for 11 seconds 00000100:00100000:2.0:1788813079.054507:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313263104 00000100:00100000:2.0:1788813079.054515:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313263104 00000100:00100000:2.0:1788813079.054558:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788813079.054568:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313263104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813079.054684:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313263104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813079.054704:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788813079.054900:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313263104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813079.054928:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313263232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813079.055005:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813079.055021:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942256300 going to sleep for 11 seconds 00000100:00100000:2.0:1788813079.055075:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313263232 00000100:00100000:2.0:1788813079.055079:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313263232 00000100:00100000:2.0:1788813079.055109:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788813079.055116:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313263232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813079.055194:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313263232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813079.055200:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788813079.055269:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313263232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788813079.057086:0:13187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788813079.057308:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788813079.057331:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813079.057342:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657400/0xf32533d6ff702b53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702b5a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813079.057353:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948943657400/0xf32533d6ff702b53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702b5a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813079.057376:0:6492:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813079.057379:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a60186000 from 7 10000000:01000000:2.0:1788813079.057382:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813079.057413:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09000/0xf32533d6ff702b61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813079.057421:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a6fc09000/0xf32533d6ff702b61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813079.057445:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a6fc09000/0xf32533d6ff702b61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813079.057467:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313263360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813079.057522:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813079.057560:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ebfd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813079.058002:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313263360 00000100:00100000:3.0:1788813079.058010:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313263360 00000100:00100000:3.0:1788813079.058511:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788813079.058522:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313263360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813079.058536:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813079.058549:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948943657a00/0xf32533d6ff702b68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702b61 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813079.058570:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948943657a00/0xf32533d6ff702b68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702b61 expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813079.058580:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948943657a00/0xf32533d6ff702b68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702b61 expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813079.058589:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657a00, rc 0) 00000100:00100000:3.0:1788813079.058636:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313263360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813079.058643:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788813079.062753:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313263360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813079.062781:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a6fc09000/0xf32533d6ff702b61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702b68 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813079.062794:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a6fc09000/0xf32533d6ff702b61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702b68 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813079.062888:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313263488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813079.062971:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813079.063011:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ebfd180 going to sleep for 11 seconds 00000100:00100000:1.0:1788813079.063120:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313263488 00000100:00100000:1.0:1788813079.063127:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313263488 00000100:00100000:1.0:1788813079.063170:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788813079.063178:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313263488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813079.063290:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313263488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813079.063311:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788813079.063791:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313263488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813079.063823:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313263616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813079.063912:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813079.064004:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ebfd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813079.064224:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313263616 00000100:00100000:3.0:1788813079.064229:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313263616 00000100:00100000:0.0:1788813079.065138:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788813079.065147:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313263616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813079.065253:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313263616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813079.065260:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788813079.065338:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313263616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788813079.068302:0:13188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788813079.068660:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788813079.068685:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788813079.068706:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09000/0xf32533d6ff702b61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702b68 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813079.068748:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a6fc09000/0xf32533d6ff702b61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702b68 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813079.396156:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813080.421986:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813080.932137:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813080.932159:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313263744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813080.932220:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813080.932276:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313263744 00000100:00100000:0.0:1788813080.932296:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313263744 00000100:00100000:0.0:1788813080.932352:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788813080.932361:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313263744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813080.932391:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813080.932442:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313263744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813080.932449:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788813080.932470:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813080.932501:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943422680 x1875706313263744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813080.932519:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313263744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813080.932815:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813080.932824:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313263872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813080.932848:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813080.932872:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313263872 00000100:00100000:0.0:1788813080.932875:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313263872 00000100:00100000:0.0:1788813080.932899:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788813080.932905:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313263872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788813080.932915:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813080.932954:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313263872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813080.932960:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788813080.932973:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813080.932987:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943422680 x1875706313263872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813080.932999:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313263872:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788813081.448694:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813081.463492:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313264000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813081.463562:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813081.463629:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313264000 00000100:00100000:0.0:1788813081.463636:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313264000 00000100:00100000:0.0:1788813081.463689:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788813081.463697:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313264000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813081.463744:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788813081.463794:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313264000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813081.463800:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788813081.463859:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313264000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813081.957181:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313264128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813081.957284:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813081.957338:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313264128 00000100:00100000:3.0:1788813081.957350:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313264128 00000100:00100000:3.0:1788813081.957431:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788813081.957443:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313264128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788813081.957492:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788813081.957569:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313264128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813081.957578:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788813081.957687:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313264128:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788813081.959650:0:13353:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788813082.471129:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813082.471159:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313264256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813082.471262:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813082.471336:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813082.471353:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313264256 00000100:00100000:0.0:1788813082.471362:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313264256 00000100:00100000:0.0:1788813082.471440:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788813082.471450:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313264256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813082.471490:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813082.471541:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313264256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813082.471555:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788813082.471580:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788813082.471616:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943423b80 x1875706313264256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813082.471635:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313264256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813082.473022:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313264384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813082.473077:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813082.473134:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313264384 00000100:00100000:3.0:1788813082.473140:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313264384 00000100:00100000:3.0:1788813082.473188:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788813082.473196:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313264384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788813082.473219:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813082.473261:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313264384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813082.473268:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788813082.473288:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788813082.473328:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943526d80 x1875706313264384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813082.473346:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313264384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813082.485634:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813082.485664:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313264512:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.485768:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813082.485863:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313264640:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.485899:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813082.485981:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313264768:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.486014:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813082.486066:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313264896:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.486091:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813082.486167:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813082.486174:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313265024:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.486201:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813082.486234:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313264768 00000100:00100000:3.0:1788813082.486243:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313264768 00000100:00100000:3.0:1788813082.486310:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313265024 00000100:00100000:3.0:1788813082.486314:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313265024 00000100:00100000:3.0:1788813082.486334:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788813082.486343:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313264768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.486407:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313264768:12345-0@lo:400:kworker.0 Request processed in 63us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813082.486415:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788813082.486436:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788813082.486442:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313265024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.486473:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313265024:12345-0@lo:400:kworker.0 Request processed in 32us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813082.486479:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788813082.486534:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313264768:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.486562:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313265024:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.486592:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313265152:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.486618:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813082.486659:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313265280:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.486682:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813082.486722:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313264640 00000100:00100000:3.0:1788813082.486726:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313264640 00000100:00100000:3.0:1788813082.486754:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313264896 00000100:00100000:3.0:1788813082.486757:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313264896 00000100:00100000:3.0:1788813082.486769:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313265152 00000100:00100000:3.0:1788813082.486771:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313265152 00000100:00100000:3.0:1788813082.486792:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313265280 00000100:00100000:3.0:1788813082.486795:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313265280 00000100:00100000:3.0:1788813082.486809:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788813082.486815:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313264640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.486846:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313264640:12345-0@lo:400:kworker.0 Request processed in 31us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813082.486852:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788813082.486864:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788813082.486870:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313264896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.486902:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313264896:12345-0@lo:400:kworker.0 Request processed in 32us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813082.486908:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788813082.486919:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788813082.486925:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313265152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.486989:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313265152:12345-0@lo:400:kworker.0 Request processed in 64us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813082.486995:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788813082.487007:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788813082.487012:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313265280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.487043:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313265280:12345-0@lo:400:kworker.0 Request processed in 31us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813082.487049:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1788813082.487070:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813082.487075:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813082.487092:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313265152:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.487103:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313264640:0@lo:400:kworker.0 00010000:00080000:3.0:1788813082.487128:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894348b100 x1875706313265280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813082.487139:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313265280:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.487157:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313264896:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.487186:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313265408:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.487214:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813082.487244:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313265408 00000100:00100000:3.0:1788813082.487248:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313265408 00000100:00100000:3.0:1788813082.487281:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788813082.487287:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313265408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.487323:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313265408:12345-0@lo:400:kworker.0 Request processed in 36us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813082.487338:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788813082.487354:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788813082.487374:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894348b100 x1875706313265408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813082.487384:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313265408:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.487413:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813082.487419:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313265536:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.487444:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813082.487482:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313265664:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.487504:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813082.487528:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313265664 00000100:00100000:3.0:1788813082.487532:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313265664 00000100:00100000:3.0:1788813082.487556:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788813082.487562:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313265664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.487593:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313265664:12345-0@lo:400:kworker.0 Request processed in 31us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813082.487599:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1788813082.487611:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813082.487626:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313265664:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.487658:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313265792:0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.487682:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813082.487718:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313265792 00000100:00100000:3.0:1788813082.487723:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313265792 00000100:00100000:3.0:1788813082.487748:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788813082.487754:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313265792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813082.487794:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313265792:12345-0@lo:400:kworker.0 Request processed in 40us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813082.487801:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788813082.487815:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788813082.487833:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943489880 x1875706313265792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813082.487843:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313265792:0@lo:400:kworker.0 00000100:00100000:2.0:1788813082.488055:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313265536 00000100:00100000:2.0:1788813082.488060:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313265536 00000100:00100000:2.0:1788813082.488095:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788813082.488101:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313265536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813082.488141:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313265536:12345-0@lo:400:kworker.0 Request processed in 41us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813082.488147:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788813082.488163:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788813082.488185:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894348b100 x1875706313265536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813082.488193:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313265536:0@lo:400:kworker.0 00000100:00100000:2.0:1788813082.488257:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313264512 00000100:00100000:2.0:1788813082.488274:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313264512 00000100:00100000:2.0:1788813082.488301:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788813082.488308:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313264512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813082.488345:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313264512:12345-0@lo:400:kworker.0 Request processed in 37us (2577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813082.488352:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788813082.488390:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313264512:0@lo:400:kworker.0 00000100:00100000:3.0:1788813083.016036:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813083.016102:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813083.016135:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813083.016163:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813083.016227:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813083.016272:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301663232 00000100:00100000:3.0:1788813083.016286:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301663232 00000100:00100000:3.0:1788813083.016355:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301663360 00000100:00100000:3.0:1788813083.016358:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301663360 00000100:00100000:3.0:1788813083.016371:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301663616 00000100:00100000:3.0:1788813083.016373:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301663616 00000100:00100000:3.0:1788813083.016383:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301663488 00000100:00100000:3.0:1788813083.016385:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301663488 00000100:00100000:3.0:1788813083.016413:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 139 00000100:00100000:3.0:1788813083.016425:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301663232:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813083.016519:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301663232:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 96us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813083.016526:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 139 00000100:00100000:3.0:1788813083.016545:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 140 00000100:00100000:3.0:1788813083.016551:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301663360:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813083.016598:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301663360:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 47us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813083.016604:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 140 00000100:00100000:3.0:1788813083.016616:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 141 00000100:00100000:3.0:1788813083.016622:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301663616:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813083.016663:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301663616:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 41us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813083.016669:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 141 00000100:00100000:3.0:1788813083.016682:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 142 00000100:00100000:3.0:1788813083.016689:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301663488:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813083.016725:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301663488:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 37us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813083.016731:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 142 00000100:00080000:2.0:1788813083.016877:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788813083.016890:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813083.017505:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301663104 00000100:00100000:1.0:1788813083.017515:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301663104 00000100:00100000:1.0:1788813083.017594:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 317 00000100:00100000:1.0:1788813083.017605:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2396:x1875706301663104:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813083.017673:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2396:x1875706301663104:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 70us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813083.017680:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 317 00010000:00010000:1.0:1788813083.492206:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813084.516144:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813085.540097:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813086.052418:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813086.052444:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313265920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813086.052514:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813086.052584:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313265920 00000100:00100000:1.0:1788813086.052592:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313265920 00000100:00100000:1.0:1788813086.052653:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788813086.052673:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313265920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788813086.052704:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813086.052748:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313265920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813086.052756:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788813086.052795:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943423b80 x1875706313265920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813086.052813:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313265920:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788813086.053437:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813086.060777:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313266048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813086.060859:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813086.061010:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313266048 00000100:00100000:0.0:1788813086.061017:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313266048 00000100:00100000:0.0:1788813086.061086:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788813086.061096:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313266048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813086.061117:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813086.061168:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313266048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813086.061174:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788813086.061725:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943489c00 x1875706313266048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813086.061744:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313266048:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788813086.062189:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813086.570612:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313266176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813086.570686:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813086.570782:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313266176 00000100:00100000:2.0:1788813086.570789:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313266176 00000100:00100000:2.0:1788813086.570837:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788813086.570846:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313266176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813086.570876:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788813086.570918:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313266176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813086.570925:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788813086.571012:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313266176:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788813086.571283:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813087.078127:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313266304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813087.078199:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813087.078296:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313266304 00000100:00100000:2.0:1788813087.078305:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313266304 00000100:00100000:2.0:1788813087.078355:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788813087.078364:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313266304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788813087.078394:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788813087.078442:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313266304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813087.078448:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788813087.078490:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313266304:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788813087.591883:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813087.592867:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313266432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813087.592968:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813087.593094:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313266432 00000100:00100000:0.0:1788813087.593101:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313266432 00000100:00100000:0.0:1788813087.593164:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788813087.593174:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313266432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813087.593204:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813087.593252:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313266432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813087.593259:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788813087.595315:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788813087.595375:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943421c00 x1875706313266432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813087.595399:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313266432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813087.610001:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313266816:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.610089:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813087.610153:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313267328:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.610177:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813087.610200:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313267840:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.610221:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813087.610247:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788813087.610254:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313266688:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.610281:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813087.610305:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313267200:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.610326:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813087.610342:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313267712:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.610376:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813087.610414:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313266816 00000100:00100000:2.0:1788813087.610423:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313266816 00000100:00100000:2.0:1788813087.610459:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313267328 00000100:00100000:2.0:1788813087.610462:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313267328 00000100:00100000:2.0:1788813087.610488:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313267840 00000100:00100000:2.0:1788813087.610491:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313267840 00000100:00100000:2.0:1788813087.610501:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313267200 00000100:00100000:2.0:1788813087.610503:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313267200 00000100:00100000:2.0:1788813087.610513:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313267712 00000100:00100000:2.0:1788813087.610515:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313267712 00000100:00100000:2.0:1788813087.610527:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788813087.610534:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313266816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.610585:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313266816:12345-0@lo:400:kworker.0 Request processed in 50us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813087.610618:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788813087.610638:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788813087.610644:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313267328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.610684:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313267328:12345-0@lo:400:kworker.0 Request processed in 41us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813087.610690:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788813087.610702:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788813087.610707:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313267840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.610743:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313267840:12345-0@lo:400:kworker.0 Request processed in 35us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813087.610747:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788813087.610758:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788813087.610764:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313267200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.610789:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313267200:12345-0@lo:400:kworker.0 Request processed in 26us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813087.610794:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788813087.610805:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788813087.610810:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313267712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.610849:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313267712:12345-0@lo:400:kworker.0 Request processed in 38us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813087.610855:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788813087.610879:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313266688 00000100:00100000:2.0:1788813087.610883:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313266688 00000100:00100000:2.0:1788813087.610910:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788813087.610916:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313266688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.610978:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313266688:12345-0@lo:400:kworker.0 Request processed in 62us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813087.610984:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00080000:2.0:1788813087.611018:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813087.611022:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788813087.611033:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313266944:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.611057:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813087.611076:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313267456:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.611099:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813087.611114:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313267968:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.611134:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813087.611151:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788813087.611156:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313266560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813087.611177:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813087.611194:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313267072:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.611215:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813087.611234:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313267584:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.611252:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813087.611277:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313266560 00000100:00100000:2.0:1788813087.611281:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313266560 00000100:00100000:2.0:1788813087.611314:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788813087.611320:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313266560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813087.611335:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813087.611368:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313266560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813087.611383:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788813087.611402:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313267072 00000100:00100000:2.0:1788813087.611405:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313267072 00000100:00100000:2.0:1788813087.611428:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788813087.611434:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313267072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.611465:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313267072:12345-0@lo:400:kworker.0 Request processed in 31us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813087.611471:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788813087.611486:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313267456 00000100:00100000:2.0:1788813087.611489:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313267456 00000100:00100000:2.0:1788813087.611507:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313267968 00000100:00100000:2.0:1788813087.611510:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313267968 00000100:00100000:2.0:1788813087.611519:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313267584 00000100:00100000:2.0:1788813087.611522:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313267584 00000100:00100000:2.0:1788813087.611533:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788813087.611539:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313267456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.611566:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313267456:12345-0@lo:400:kworker.0 Request processed in 27us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813087.611572:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788813087.611582:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788813087.611588:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313267968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.611612:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313267968:12345-0@lo:400:kworker.0 Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813087.611618:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788813087.611627:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788813087.611633:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313267584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.611684:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313267584:12345-0@lo:400:kworker.0 Request processed in 51us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813087.611690:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788813087.611715:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813087.611739:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313266688:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.611753:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313267200:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.611763:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313267712:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.611774:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313266816:0@lo:400:kworker.0 00010000:00080000:2.0:1788813087.611785:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943642300 x1875706313267328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813087.611794:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313267328:0@lo:400:kworker.0 00010000:00080000:2.0:1788813087.611803:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943754a80 x1875706313267840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813087.611811:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313267840:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.611842:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313266944 00000100:00100000:2.0:1788813087.611846:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313266944 00000100:00100000:2.0:1788813087.611869:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788813087.611875:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313266944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.611904:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313266944:12345-0@lo:400:kworker.0 Request processed in 29us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813087.611910:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00010000:00080000:2.0:1788813087.611960:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489434e6a00 x1875706313266560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813087.611985:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313266560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813087.611996:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313267072:0@lo:400:kworker.0 00010000:00080000:2.0:1788813087.612005:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943757480 x1875706313267584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813087.612012:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313267584:0@lo:400:kworker.0 00000100:00100000:2.0:1788813087.612020:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313266944:0@lo:400:kworker.0 00010000:00080000:2.0:1788813087.612028:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943755880 x1875706313267456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813087.612035:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313267456:0@lo:400:kworker.0 00010000:00080000:2.0:1788813087.612044:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943756300 x1875706313267968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813087.612052:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313267968:0@lo:400:kworker.0 00000100:00100000:1.0:1788813088.155293:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813088.155464:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813088.155497:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813088.155518:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813088.155557:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813088.155586:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301664000 00000100:00100000:1.0:1788813088.155596:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301664000 00000100:00100000:1.0:1788813088.155664:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301664256 00000100:00100000:1.0:1788813088.155668:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301664256 00000100:00100000:1.0:1788813088.155683:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301663872 00000100:00100000:1.0:1788813088.155686:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301663872 00000100:00100000:1.0:1788813088.155698:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301664128 00000100:00100000:1.0:1788813088.155700:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301664128 00000100:00100000:1.0:1788813088.155714:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 149 00000100:00100000:1.0:1788813088.155723:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301664000:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813088.155797:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301664000:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 75us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813088.155805:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 149 00000100:00100000:1.0:1788813088.155822:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 150 00000100:00100000:1.0:1788813088.155828:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301664256:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813088.155851:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301664256:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 23us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813088.155856:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 150 00000100:00100000:1.0:1788813088.155866:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 151 00000100:00100000:1.0:1788813088.155873:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2398:x1875706301663872:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813088.155907:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2398:x1875706301663872:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 34us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813088.155913:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 151 00000100:00100000:1.0:1788813088.155925:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 152 00000100:00100000:1.0:1788813088.155950:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301664128:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813088.155975:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301664128:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 45us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813088.155981:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 152 00000100:00080000:1.0:1788813088.156005:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813088.156008:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788813088.159619:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301663744 00000100:00100000:2.0:1788813088.159636:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301663744 00000100:00100000:2.0:1788813088.159707:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 319 00000100:00100000:2.0:1788813088.159718:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301663744:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813088.159801:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301663744:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 85us (4521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813088.159809:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 319 00010000:00010000:0.0:1788813088.612168:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813089.641820:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788813090.137008:0:13502:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:31:28 (1788813088) === 00010000:00010000:0.0:1788813090.660111:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813090.780709:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813090.780815:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813090.780926:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301664384 00000100:00100000:2.0:1788813090.780997:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301664384 00000100:00100000:0.0:1788813090.781060:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301664512 00000100:00100000:0.0:1788813090.781076:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301664512 00000100:00100000:2.0:1788813090.781092:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:2.0:1788813090.781124:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2398:x1875706301664384:12345-192.168.202.13@tcp:41:mkdir.0 00000100:00100000:0.0:1788813090.781141:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2 00000100:00100000:0.0:1788813090.781154:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:10472:x1875706301664512:12345-192.168.202.13@tcp:700:mkdir.0 00000004:00000024:2.0:1788813090.781184:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788813090.781263:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:10472:x1875706301664512:12345-192.168.202.13@tcp:700:mkdir.0 Request processed in 111us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813090.781272:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2398:x1875706301664384:12345-192.168.202.13@tcp:41:mkdir.0 Request processed in 148us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813090.781281:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2 00000100:00100000:2.0:1788813090.781295:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00080000:1.0:1788813090.781644:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813090.784743:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813090.785005:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301664768 00000100:00100000:1.0:1788813090.785018:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301664768 00000100:00100000:1.0:1788813090.785090:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:1.0:1788813090.785100:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:10472:x1875706301664768:12345-192.168.202.13@tcp:36:mkdir.0 00010000:00010000:1.0:1788813090.785179:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813090.785851:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70295b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07295c4 expref: 6 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.785883:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6aed9100) 00010000:00010000:1.0:1788813090.785897:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813090.786069:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.786868:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.786879:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.786894:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702b76 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.786902:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702b76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.786909:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702b76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.788822:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702b7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.788841:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702b7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.788851:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702b7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813090.788865:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4ce8e36 reply state 00000000c5776080 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702b7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.788877:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702b7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.788884:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948a455ee400) 00010000:00010000:1.0:1788813090.788894:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788813090.788899:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788813090.788904:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788813090.788912:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.788918:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b6f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.788925:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.788965:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813090.788970:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.788978:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b6f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.788988:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a455ee700) 00010000:00010000:1.0:1788813090.788991:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813090.788995:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b6f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.789004:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b6f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813090.789030:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4ce8e36 reply state 00000000c5776080 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702b76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.789481:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702b76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.789499:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff948a455ee100) 00010000:00010000:1.0:1788813090.789501:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788813090.789504:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788813090.789627:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:10472:x1875706301664768:12345-192.168.202.13@tcp:36:mkdir.0 Request processed in 4516us (4882us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788813090.789637:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:0.0:1788813090.797489:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813090.797801:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301664896 00000100:00100000:2.0:1788813090.797814:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301664896 00000100:00100000:2.0:1788813090.797891:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:2.0:1788813090.797903:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:10473:x1875706301664896:12345-192.168.202.13@tcp:101:chmod.0 00010000:00010000:2.0:1788813090.797977:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813090.798011:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702b84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729657 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813090.798093:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702b8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813090.798110:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702b8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813090.798127:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702b8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813090.798201:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788813090.798205:0:12571:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788813090.798248:0:12571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702b8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813090.798282:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702b84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729657 expref: 9 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813090.798335:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702b8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729657 expref: 8 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813090.798346:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948942fffb00) 00010000:00010000:2.0:1788813090.798350:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813090.798355:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08800, rc 0) 00000100:00100000:2.0:1788813090.798436:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:10473:x1875706301664896:12345-192.168.202.13@tcp:101:chmod.0 Request processed in 535us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813090.798444:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:3.0:1788813090.805112:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813090.807802:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301665152 00000100:00100000:0.0:1788813090.807827:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301665152 00000100:00100000:1.0:1788813090.808229:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:1.0:1788813090.808246:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:10473:x1875706301665152:12345-192.168.202.13@tcp:36:chmod.0 00010000:00010000:1.0:1788813090.808328:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813090.808363:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702b8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729657 expref: 8 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.808390:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948942fffb00) 00010000:00010000:1.0:1788813090.808404:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813090.808445:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b92 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.808463:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.808475:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813090.808755:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a883435 reply state 0000000053087ff8 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.808768:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.808785:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a455ee700) 00010000:00010000:1.0:1788813090.808788:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788813090.808800:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788813090.808810:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788813090.809420:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:10473:x1875706301665152:12345-192.168.202.13@tcp:36:chmod.0 Request processed in 1177us (4317us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788813090.809433:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:3.0:1788813090.861670:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813090.861873:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301665280 00000100:00100000:1.0:1788813090.861886:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301665280 00000100:00100000:1.0:1788813090.861995:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 26 00000100:00100000:1.0:1788813090.862006:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:10474:x1875706301665280:12345-192.168.202.13@tcp:101:chown.0 00010000:00010000:0.0:1788813090.862525:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813090.862557:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702b99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072965e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813090.862666:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702ba0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813090.862684:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813090.862698:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813090.862759:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788813090.862763:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813090.862805:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813090.862847:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702b99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072965e expref: 11 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813090.862887:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072965e expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813090.862897:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a455ee700) 00010000:00010000:0.0:1788813090.862900:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813090.862905:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdbc00, rc 0) 00000100:00100000:2.0:1788813090.866241:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813090.866463:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301665408 00000100:00100000:1.0:1788813090.866476:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301665408 00000100:00100000:1.0:1788813090.866547:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 27 00000100:00100000:1.0:1788813090.866560:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+11:10474:x1875706301665408:12345-192.168.202.13@tcp:101:chown.0 00010000:00010000:1.0:1788813090.866594:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813090.866649:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff702ba7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729665 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.866730:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702bae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.866748:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702bae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.866762:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702bae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.866796:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702bb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.866804:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.866811:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.866898:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702bbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.866907:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702bbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.866913:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702bbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813090.867008:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788813090.867012:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788813090.867045:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702bbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867059:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702bae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867066:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702bae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867074:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702bae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867089:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813090.867094:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702bae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867102:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702bae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867117:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a455ee700) 00010000:00010000:1.0:1788813090.867120:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813090.867125:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702bae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867140:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702bae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867156:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867162:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702bb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867168:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867173:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813090.867175:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867180:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867195:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff948a455ee100) 00010000:00010000:1.0:1788813090.867198:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813090.867200:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702bb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867206:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702bb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867233:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff702ba7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729665 expref: 13 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867247:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702bbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729665 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.867255:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948a455ee400) 00010000:00010000:1.0:1788813090.867258:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813090.867260:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8a00, rc 0) 00000100:00100000:0.0:1788813090.868001:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+12:10474:x1875706301665280:12345-192.168.202.13@tcp:101:chown.0 Request processed in 1023us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813090.868013:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 26 00000100:00100000:1.0:1788813090.868646:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+11:10474:x1875706301665408:12345-192.168.202.13@tcp:101:chown.0 Request processed in 2021us (2348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813090.868656:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 27 00000100:00100000:2.0:1788813090.872647:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813090.872714:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301665536 00000100:00100000:0.0:1788813090.872727:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301665536 00000100:00100000:0.0:1788813090.872791:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00100000:0.0:1788813090.872803:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+11:10474:x1875706301665536:12345-192.168.202.13@tcp:900:chown.0 00000100:00100000:0.0:1788813090.883437:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+11:10474:x1875706301665536:12345-192.168.202.13@tcp:900:chown.0 Request processed in 10620us (10784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813090.883457:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00100000:0.0:1788813090.901203:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813090.901483:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301665792 00000100:00100000:1.0:1788813090.901498:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301665792 00000100:00100000:1.0:1788813090.901573:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:1.0:1788813090.901592:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+11:10474:x1875706301665792:12345-192.168.202.13@tcp:36:chown.0 00010000:00010000:1.0:1788813090.901671:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813090.901703:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702bbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729665 expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.901749:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948a455ee400) 00010000:00010000:1.0:1788813090.901755:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813090.901785:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff702bc3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.901801:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff702bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.901812:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff702bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813090.905877:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1788813090.906033:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4ce6c1d reply state 00000000b0b31e0b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff702bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813090.906071:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff702bc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813090.906084:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948a455ee400) 00010000:00010000:2.0:1788813090.906087:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788813090.906095:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788813090.906111:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1788813090.906253:0:6495:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788813090.906382:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:10474:x1875706301665792:12345-192.168.202.13@tcp:36:chown.0 Request processed in 4792us (5184us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788813090.906395:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 28 00010000:00010000:0.0:1788813090.906569:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff702bc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813090.906588:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff702bc3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813090.906595:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff702bc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813090.906630:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813090.906635:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff702bc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813090.906643:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff702bc3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813090.906659:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948a455ee400) 00010000:00010000:0.0:1788813090.906663:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788813090.906668:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff702bc3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813090.906673:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff702bc3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907097:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702b76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907107:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702b76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907113:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702b76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907117:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813090.907120:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702b76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907127:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702b76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907136:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff948a455ee100) 00010000:00010000:1.0:1788813090.907139:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813090.907142:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702b76 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907154:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702b76 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907171:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702b7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907177:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702b7d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907183:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702b7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907188:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813090.907192:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702b7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907197:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702b7d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907214:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948a455ee400) 00010000:00010000:1.0:1788813090.907217:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813090.907219:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702b7d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907224:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702b7d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907246:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907252:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907265:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907270:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813090.907273:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907279:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907288:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a455ee700) 00010000:00010000:1.0:1788813090.907290:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788813090.907602:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b92 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813090.907611:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702b92 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813090.939296:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813090.939404:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301665920 00000100:00100000:3.0:1788813090.939436:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301665920 00000100:00100000:3.0:1788813090.939668:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00100000:3.0:1788813090.939681:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:10475:x1875706301665920:12345-192.168.202.13@tcp:101:touch.500 00010000:00010000:3.0:1788813090.939712:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813090.939741:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff702bca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072966c expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813090.942370:0:9156:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2560us 00010000:00010000:0.0:1788813091.003810:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702bd1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.003839:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.003852:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.003869:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702bd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.003876:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.003890:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004082:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff702bdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004091:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff702bdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004099:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff702bdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813091.004129:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788813091.004135:0:9156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813091.004170:0:9156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff702bdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004181:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004187:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702bd1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004193:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702bd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004198:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813091.004202:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702bd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004208:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702bd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004227:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a455ee700) 00010000:00010000:0.0:1788813091.004231:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813091.004237:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702bd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004243:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702bd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004253:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004259:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702bd8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004264:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004269:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813091.004272:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004277:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702bd8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004284:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff948a74a15400) 00010000:00010000:0.0:1788813091.004286:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813091.004289:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702bd8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004294:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702bd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004342:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff702bca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072966c expref: 8 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004357:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff702bdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072966c expref: 7 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.004365:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948a74a15c00) 00010000:00010000:0.0:1788813091.004368:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788813091.004370:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e5200, rc 0) 00000100:00100000:0.0:1788813091.004435:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:10475:x1875706301665920:12345-192.168.202.13@tcp:101:touch.500 Request processed in 64755us (65150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813091.004444:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00100000:3.0:1788813091.014589:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813091.016520:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301666176 00000100:00100000:1.0:1788813091.016543:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301666176 00000100:00100000:1.0:1788813091.016631:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:1.0:1788813091.016643:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:10475:x1875706301666176:12345-192.168.202.13@tcp:101:touch.500 00010000:00010000:1.0:1788813091.016665:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813091.016687:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702be6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729673 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.016808:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702bed lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.016835:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702bed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.016865:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702bed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.016903:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702bf4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.016911:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.016918:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788813091.017338:0:6494:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788813091.017475:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702bfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.017485:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702bfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.017492:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702bfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.017519:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702bed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.017527:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702bed lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.017534:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702bed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.017541:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813091.017551:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702bed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.017560:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702bed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.017572:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948a74a15c00) 00010000:00010000:1.0:1788813091.017576:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813091.017581:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702bed lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.017588:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702bed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813091.017602:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cabc1bad reply state 000000001597a2bf transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.017614:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702bf4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.017636:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6274d149 (ffff948a455ee400) 00010000:00010000:1.0:1788813091.017638:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788813091.017641:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788813091.017669:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702be6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729673 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.017684:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702bfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729673 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.017691:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff948a455ee100) 00010000:00010000:1.0:1788813091.017693:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813091.017701:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8a00, rc 0) 00000100:00100000:1.0:1788813091.017776:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+10:10475:x1875706301666176:12345-192.168.202.13@tcp:101:touch.500 Request processed in 1136us (3205us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788813091.017785:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:0.0:1788813091.039168:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813091.042145:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301666432 00000100:00100000:2.0:1788813091.042169:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301666432 00000100:00100000:2.0:1788813091.042291:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:2.0:1788813091.042325:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+10:10475:x1875706301666432:12345-192.168.202.13@tcp:36:touch.500 00010000:00010000:2.0:1788813091.042400:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813091.042446:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702bfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729673 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.042474:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff948a455ee100) 00010000:00010000:2.0:1788813091.042487:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813091.042567:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702c09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.042594:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702c09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.042607:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702c09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813091.042767:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5147878 reply state 0000000065e287a5 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702c09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.042782:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702c09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.042790:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff948942fffa00) 00010000:00010000:2.0:1788813091.042793:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788813091.042796:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813091.042923:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+11:10475:x1875706301666432:12345-192.168.202.13@tcp:36:touch.500 Request processed in 611us (3794us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788813091.042998:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:3.0:1788813091.047396:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813091.048296:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301666560 00000100:00100000:0.0:1788813091.048310:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301666560 00000100:00100000:0.0:1788813091.048386:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 32 00000100:00100000:0.0:1788813091.048396:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+11:10475:x1875706301666560:12345-192.168.202.13@tcp:101:touch.500 00010000:00010000:0.0:1788813091.048420:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813091.048442:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff702c10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072967a expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.048498:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff702c10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072967a expref: 12 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.048512:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff702c10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072967a expref: 12 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.048551:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff948942fffa00) 00010000:00010000:0.0:1788813091.048555:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813091.048559:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e5800, rc 0) 00000100:00100000:0.0:1788813091.049070:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+12:10475:x1875706301666560:12345-192.168.202.13@tcp:101:touch.500 Request processed in 674us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813091.049077:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 32 00000100:00100000:3.0:1788813091.063801:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813091.065303:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301666688 00000100:00100000:2.0:1788813091.065345:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301666688 00000100:00100000:2.0:1788813091.065512:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:2.0:1788813091.065523:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1875706301666688:12345-192.168.202.13@tcp:8:touch.500 00010000:00080000:2.0:1788813091.065573:0:8403:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:2.0:1788813091.065633:0:8403:0:(genops.c:1384:class_connect()) connect: client d2fa4f95-78d4-4e44-8582-bb12ec2edfd4, cookie 0xf32533d6ff702c17 00002000:00100000:2.0:1788813091.065650:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d2fa4f95-78d4-4e44-8582-bb12ec2edfd4/ffff948941927800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788813091.065675:0:8403:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788813091.065787:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788813091.065832:0:8403:0:(import.c:65:import_set_state_nolock()) ffff948941922000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813091.065978:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2395:x1875706301666688:12345-192.168.202.13@tcp:8:touch.500 Request processed in 409us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813091.065987:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:1.0:1788813091.073143:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813091.073228:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301666816 00000100:00100000:3.0:1788813091.073238:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301666816 00000100:00100000:3.0:1788813091.073324:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:3.0:1788813091.073336:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:0:x1875706301666816:12345-192.168.202.13@tcp:2:touch.500 00000100:00080000:1.0:1788813091.075585:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788813091.089595:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:3.0:1788813091.089613:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000100:00100000:0.0:1788813091.090157:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:0:x1875706301666816:12345-192.168.202.13@tcp:2:touch.500 Request processed in 16809us (17012us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788813091.090174:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:3.0:1788813091.108332:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813091.109727:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301667072 00000100:00100000:0.0:1788813091.109743:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301667072 00000100:00100000:0.0:1788813091.109844:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2 00000100:00100000:0.0:1788813091.109857:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+12:10475:x1875706301667072:12345-192.168.202.13@tcp:35:touch.500 00000100:00100000:2.0:1788813091.111604:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+13:10475:x1875706301667072:12345-192.168.202.13@tcp:35:touch.500 Request processed in 1739us (3828us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788813091.111627:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2 00000100:00100000:3.0:1788813091.166850:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813091.168146:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301667200 00000100:00100000:1.0:1788813091.168159:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301667200 00000100:00100000:1.0:1788813091.168306:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 33 00000100:00100000:1.0:1788813091.168327:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+13:10476:x1875706301667200:12345-192.168.202.13@tcp:101:rm.0 00010000:00010000:1.0:1788813091.168352:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813091.168375:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702c1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729681 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.168450:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702c25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.168463:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702c25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.168475:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702c25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813091.168519:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788813091.168523:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788813091.168560:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702c25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.168597:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702c1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729681 expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.168646:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702c25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729681 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813091.168655:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948a74a15c00) 00010000:00010000:1.0:1788813091.168658:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813091.168661:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8000, rc 0) 00000100:00100000:1.0:1788813091.168730:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:10476:x1875706301667200:12345-192.168.202.13@tcp:101:rm.0 Request processed in 414us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813091.168737:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 33 00000100:00100000:2.0:1788813091.174453:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313268096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813091.174528:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813091.182344:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313268096 00000100:00100000:3.0:1788813091.182365:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313268096 00000100:00100000:3.0:1788813091.182432:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788813091.182444:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313268096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813091.182476:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813091.182549:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313268096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (8021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813091.182556:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1788813091.182748:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943526300 x1875706313268096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813091.182767:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313268096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813091.182826:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813091.185011:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313268224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813091.185096:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813091.185964:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313268224 00000100:00100000:2.0:1788813091.185975:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313268224 00000100:00100000:2.0:1788813091.186033:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788813091.186042:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313268224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788813091.186073:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813091.186124:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313268224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813091.186131:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1788813091.186365:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943526300 x1875706313268224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813091.186385:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313268224:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788813091.186526:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813091.200741:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301667456 00000100:00100000:0.0:1788813091.200762:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301667456 00000100:00100000:2.0:1788813091.201142:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 34 00000100:00100000:2.0:1788813091.201154:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:10476:x1875706301667456:12345-192.168.202.13@tcp:101:rm.0 00010000:00010000:2.0:1788813091.201175:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813091.201199:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729688 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813091.201301:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788813091.201462:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729688 expref: 16 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.201475:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a455ee700) 00010000:00010000:2.0:1788813091.201478:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813091.201484:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729688 expref: 16 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.201498:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08200, rc 0) 00000100:00100000:2.0:1788813091.201563:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:10476:x1875706301667456:12345-192.168.202.13@tcp:101:rm.0 Request processed in 412us (18739us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788813091.201593:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 34 00000100:00100000:0.0:1788813091.210395:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813091.210507:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301667584 00000100:00100000:3.0:1788813091.210517:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301667584 00000100:00100000:3.0:1788813091.210562:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:3.0:1788813091.210584:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:10476:x1875706301667584:12345-192.168.202.13@tcp:37:rm.0 00000100:00100000:1.0:1788813091.221598:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:10476:x1875706301667584:12345-192.168.202.13@tcp:37:rm.0 Request processed in 11013us (11200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813091.221627:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:1.0:1788813091.236784:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813091.237027:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301667840 00000100:00100000:2.0:1788813091.237036:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301667840 00000100:00100000:2.0:1788813091.237092:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4 00000100:00100000:2.0:1788813091.237102:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50e12850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:10476:x1875706301667840:12345-192.168.202.13@tcp:35:rm.0 00000100:00100000:2.0:1788813091.237314:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50e12850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:10476:x1875706301667840:12345-192.168.202.13@tcp:35:rm.0 Request processed in 213us (541us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788813091.237334:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4 00000100:00100000:0.0:1788813091.242402:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813091.242533:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301668096 00000100:00100000:2.0:1788813091.242542:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301668096 00000100:00100000:2.0:1788813091.242610:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 35 00000100:00100000:2.0:1788813091.242628:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:10476:x1875706301668096:12345-192.168.202.13@tcp:101:rm.0 00010000:00010000:2.0:1788813091.242649:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813091.242668:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072968f expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.242776:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff702c41 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.242790:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff702c41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.242801:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff702c41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813091.242810:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788813091.242910:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072968f expref: 19 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.242992:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff702c41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072968f expref: 18 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.243001:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948a74a15c00) 00010000:00010000:2.0:1788813091.243004:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788813091.243008:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09600, rc 0) 00000100:00100000:2.0:1788813091.243060:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:10476:x1875706301668096:12345-192.168.202.13@tcp:101:rm.0 Request processed in 433us (667us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788813091.243067:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 35 00000100:00100000:3.0:1788813091.250323:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813091.250455:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301668224 00000100:00100000:0.0:1788813091.250465:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301668224 00000100:00100000:0.0:1788813091.250524:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 36 00000100:00100000:0.0:1788813091.250534:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:10476:x1875706301668224:12345-192.168.202.13@tcp:41:rm.0 00000004:00000024:0.0:1788813091.250598:0:12571:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788813091.250680:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:10476:x1875706301668224:12345-192.168.202.13@tcp:41:rm.0 Request processed in 146us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813091.250687:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 36 00000100:00100000:1.0:1788813091.259480:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813091.259925:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301668352 00000100:00100000:2.0:1788813091.259951:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301668352 00000100:00100000:2.0:1788813091.260005:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 37 00000100:00100000:2.0:1788813091.260014:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:10476:x1875706301668352:12345-192.168.202.13@tcp:101:rm.0 00010000:00010000:2.0:1788813091.260033:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813091.260051:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729696 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260112:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c56 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260138:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260149:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260160:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260179:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260185:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260278:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08400/0xf32533d6ff702c64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260286:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08400/0xf32533d6ff702c64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260293:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08400/0xf32533d6ff702c64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813091.260326:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788813091.260329:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788813091.260345:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08400/0xf32533d6ff702c64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260355:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08400/0xf32533d6ff702c64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260362:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260368:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c56 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260374:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260388:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813091.260392:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260399:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c56 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260411:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948a74a15c00) 00010000:00010000:2.0:1788813091.260414:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813091.260418:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c56 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260424:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c56 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260435:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260440:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c5d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260445:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260450:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813091.260452:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260458:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c5d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260474:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6274d149 (ffff948a455ee400) 00010000:00010000:2.0:1788813091.260476:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813091.260479:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c5d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260484:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260506:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729696 expref: 20 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260518:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08400/0xf32533d6ff702c64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729696 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.260524:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff948942fffa00) 00010000:00010000:2.0:1788813091.260526:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813091.260528:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08400, rc 0) 00000100:00100000:2.0:1788813091.261033:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:10476:x1875706301668352:12345-192.168.202.13@tcp:101:rm.0 Request processed in 1017us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813091.261041:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 37 00000100:00100000:3.0:1788813091.268524:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813091.272921:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301668608 00000100:00100000:0.0:1788813091.272987:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301668608 00000100:00100000:2.0:1788813091.278909:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 38 00000100:00100000:2.0:1788813091.278922:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:10476:x1875706301668608:12345-192.168.202.13@tcp:36:rm.0 00010000:00010000:2.0:1788813091.279005:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788813091.279031:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08400/0xf32533d6ff702c64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729696 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.279056:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff702c10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072967a expref: 18 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.279082:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff948942fffa00) 00010000:00010000:2.0:1788813091.279093:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8000/0xf32533d6ff702c25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729681 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.279103:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948a74a15c00) 00010000:00010000:2.0:1788813091.279107:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813091.279322:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c6b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.279337:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.279347:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.279359:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c72 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.279366:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.279373:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.279458:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c79 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.279467:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.279484:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813091.280595:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788813091.280606:0:6496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 244299673680ns, next at 245299671338ns, rc = 0 00010000:00010000:2.0:1788813091.282032:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702c80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282050:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702c80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282061:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702c80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282069:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702c80 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282075:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702c80 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282082:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702c80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282097:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813091.282117:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282123:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c79 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282129:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c79 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282146:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813091.282150:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c79 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282158:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c79 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282170:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff948942fffa00) 00010000:00010000:2.0:1788813091.282173:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788813091.282177:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c79 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282184:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702c79 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282203:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282210:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c6b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282216:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c6b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282220:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813091.282222:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c6b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282227:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c6b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282244:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948a74a15c00) 00010000:00010000:2.0:1788813091.282246:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813091.282249:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c6b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282255:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702c6b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813091.282265:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc8c4217 reply state 0000000032461976 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282276:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813091.282282:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6274d149 (ffff948a455ee400) 00010000:00010000:2.0:1788813091.282283:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788813091.282286:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788813091.283738:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813091.283750:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702c80 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.283759:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08800 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813091.283763:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702c80 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.283771:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702c80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.283783:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff948942fffa00) 00010000:00010000:0.0:1788813091.283786:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788813091.283789:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702c80 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.283795:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702c80 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.283812:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813091.283815:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813091.283816:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813091.284633:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:10476:x1875706301668608:12345-192.168.202.13@tcp:36:rm.0 Request processed in 5706us (16114us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788813091.284643:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 38 00000100:00100000:1.0:1788813091.297842:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813091.298066:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301668864 00000100:00100000:2.0:1788813091.298077:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301668864 00000100:00100000:2.0:1788813091.298142:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:2.0:1788813091.298153:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:10476:x1875706301668864:12345-192.168.202.13@tcp:35:rm.0 00000100:00100000:2.0:1788813091.298379:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:10476:x1875706301668864:12345-192.168.202.13@tcp:35:rm.0 Request processed in 228us (550us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788813091.298387:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:1.0:1788813091.305317:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813091.305478:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301669120 00000100:00100000:0.0:1788813091.305489:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301669120 00000100:00100000:0.0:1788813091.305552:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 39 00000100:00100000:0.0:1788813091.305562:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:10476:x1875706301669120:12345-192.168.202.13@tcp:36:rm.0 00010000:00010000:0.0:1788813091.305638:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788813091.305665:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff702c41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072968f expref: 19 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.305705:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff702bdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072966c expref: 18 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.305717:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948a74a15c00) 00010000:00010000:0.0:1788813091.305894:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702ba0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072965e expref: 17 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.305905:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a455ee700) 00010000:00010000:0.0:1788813091.305912:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813091.305986:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff702c87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.305999:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff702c87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306009:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff702c87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306021:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff702c8e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306038:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff702c8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306046:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff702c8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306130:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff702c95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306149:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff702c95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306156:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff702c95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813091.306397:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788813091.306410:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff702c95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306416:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff702c95 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306422:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff702c95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306427:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813091.306431:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff702c95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306438:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff702c95 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306445:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948a74a15d00) 00010000:00010000:0.0:1788813091.306447:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788813091.306451:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff702c95 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306457:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff702c95 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306474:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff702c87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306486:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff702c87 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306491:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff702c87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306495:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813091.306499:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff702c87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306504:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff702c87 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306511:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a74a15400) 00010000:00010000:0.0:1788813091.306513:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813091.306516:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff702c87 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306522:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff702c87 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813091.306532:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf82e43d reply state 0000000004cd6866 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff702c8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306542:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff702c8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813091.306548:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff948a74a15500) 00010000:00010000:0.0:1788813091.306550:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788813091.306552:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813091.308943:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:10476:x1875706301669120:12345-192.168.202.13@tcp:36:rm.0 Request processed in 3356us (3610us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788813091.308967:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 39 00000100:00100000:3.0:1788813091.685179:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813091.685203:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313268352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813091.685272:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813091.685547:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813091.687732:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313268352 00000100:00100000:2.0:1788813091.687765:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313268352 00000100:00100000:2.0:1788813091.687843:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788813091.687853:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313268352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813091.687888:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788813091.687997:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313268352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (2725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813091.688004:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788813091.688206:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313268352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813092.197255:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813092.197279:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894365aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313268480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813092.197357:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813092.197585:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313268480 00000100:00100000:2.0:1788813092.197593:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313268480 00000100:00100000:2.0:1788813092.197657:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788813092.197667:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313268480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788813092.197701:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1788813092.197757:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313268480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813092.197765:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788813092.197857:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894365aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313268480:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788813092.708138:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813092.708446:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313268864:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.708513:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813092.708581:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313269376:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.708615:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813092.708633:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313269888:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.708651:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813092.708671:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788813092.708675:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313268736:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.708692:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813092.708704:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894365aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313269248:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.708722:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813092.708748:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313269760:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.708776:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813092.708816:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313269376 00000100:00100000:2.0:1788813092.708823:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313269376 00000100:00100000:2.0:1788813092.708863:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313269888 00000100:00100000:2.0:1788813092.708866:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313269888 00000100:00100000:2.0:1788813092.708888:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788813092.708895:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313269376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.708969:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313269376:12345-0@lo:400:kworker.0 Request processed in 74us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813092.708976:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788813092.708992:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788813092.708998:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313269888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.709020:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313269888:12345-0@lo:400:kworker.0 Request processed in 23us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813092.709025:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788813092.709046:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813092.709060:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313268992:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.709085:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813092.709115:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313269504:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.709134:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813092.709150:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313270016:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.709167:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813092.709183:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788813092.709188:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313268608:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.709212:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813092.709241:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313269120:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.709261:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813092.709273:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313269632:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.709288:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813092.709306:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313268608 00000100:00100000:2.0:1788813092.709310:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313268608 00000100:00100000:2.0:1788813092.709338:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788813092.709344:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313268608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.709374:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313268608:12345-0@lo:400:kworker.0 Request processed in 31us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813092.709380:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788813092.709408:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313269504 00000100:00100000:2.0:1788813092.709411:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313269504 00000100:00100000:2.0:1788813092.709430:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313270016 00000100:00100000:2.0:1788813092.709432:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313270016 00000100:00100000:2.0:1788813092.709453:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788813092.709458:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313269504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.709487:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313269504:12345-0@lo:400:kworker.0 Request processed in 29us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813092.709492:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788813092.709504:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788813092.709509:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313270016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.709534:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313270016:12345-0@lo:400:kworker.0 Request processed in 25us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813092.709540:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788813092.709556:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813092.709581:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313268608:0@lo:400:kworker.0 00010000:00080000:2.0:1788813092.709614:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76416300 x1875706313269504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813092.709625:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313269504:0@lo:400:kworker.0 00010000:00080000:2.0:1788813092.709636:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943640700 x1875706313270016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813092.709644:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313270016:0@lo:400:kworker.0 00010000:00080000:2.0:1788813092.709673:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943659c00 x1875706313269376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813092.709681:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313269376:0@lo:400:kworker.0 00010000:00080000:2.0:1788813092.709690:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7fd91180 x1875706313269888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813092.709697:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313269888:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.709716:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313268864 00000100:00100000:2.0:1788813092.709720:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313268864 00000100:00100000:2.0:1788813092.709741:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313268736 00000100:00100000:2.0:1788813092.709744:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313268736 00000100:00100000:2.0:1788813092.709754:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313269248 00000100:00100000:2.0:1788813092.709756:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313269248 00000100:00080000:2.0:1788813092.709769:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788813092.709780:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313269760 00000100:00100000:2.0:1788813092.709782:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313269760 00000100:00080000:2.0:1788813092.709792:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788813092.709803:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313269120 00000100:00100000:2.0:1788813092.709806:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313269120 00000100:00080000:2.0:1788813092.709816:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813092.709826:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313269632 00000100:00100000:2.0:1788813092.709836:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313269632 00000100:00080000:2.0:1788813092.709848:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813092.709864:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788813092.709870:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313268864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.709906:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313268864:12345-0@lo:400:kworker.0 Request processed in 35us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813092.709912:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788813092.709958:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313268864:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.709978:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788813092.709985:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313268736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.710015:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313268736:12345-0@lo:400:kworker.0 Request processed in 31us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813092.710021:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788813092.710041:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313268736:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.710057:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788813092.710063:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313269248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.710092:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313269248:12345-0@lo:400:kworker.0 Request processed in 29us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813092.710097:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00010000:00080000:2.0:1788813092.710118:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894365aa00 x1875706313269248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813092.710126:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894365aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313269248:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.710141:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788813092.710146:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313269760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.710189:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313269760:12345-0@lo:400:kworker.0 Request processed in 43us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813092.710195:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00010000:00080000:2.0:1788813092.710218:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943526300 x1875706313269760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813092.710226:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313269760:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.710244:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788813092.710250:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313269120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.710280:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313269120:12345-0@lo:400:kworker.0 Request processed in 30us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813092.710285:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788813092.710306:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313269120:0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.710323:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788813092.710329:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313269632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813092.710361:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313269632:12345-0@lo:400:kworker.0 Request processed in 32us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813092.710366:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788813092.710388:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313269632:0@lo:400:kworker.0 00000100:00100000:1.0:1788813092.710536:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313268992 00000100:00100000:1.0:1788813092.710541:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313268992 00000100:00100000:1.0:1788813092.710570:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788813092.710583:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313268992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813092.710634:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313268992:12345-0@lo:400:kworker.0 Request processed in 51us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813092.710640:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000004:00080000:0.0:1788813092.710864:0:10070:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 245729930534ns, next at 246729927868ns, rc = 0 00000100:00100000:1.0:1788813092.710955:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813092.710967:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313270272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813092.711010:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813092.711090:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313270272 00000100:00100000:0.0:1788813092.711095:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313270272 00000100:00100000:0.0:1788813092.711139:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788813092.711145:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313270272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813092.711159:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813092.711189:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313270272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813092.711195:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788813092.711305:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943754380 x1875706313270272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813092.711319:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313270272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813092.711749:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313270144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813092.711780:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813092.711957:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313270144 00000100:00100000:0.0:1788813092.711962:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313270144 00000100:00100000:0.0:1788813092.711994:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788813092.712000:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313270144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788813092.712011:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813092.712048:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313270144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813092.712054:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1788813092.712218:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489434e7100 x1875706313270144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813092.712232:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313270144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813092.718844:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313268992:0@lo:400:kworker.0 00000100:00100000:3.0:1788813093.249217:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813093.249255:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813093.249274:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813093.249306:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813093.249326:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813093.249345:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813093.249388:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301669632 00000100:00100000:3.0:1788813093.249399:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301669632 00000100:00100000:3.0:1788813093.249453:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:3.0:1788813093.249462:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301669632:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813093.249524:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301669632:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 64us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813093.249531:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:3.0:1788813093.249551:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301669376 00000100:00100000:3.0:1788813093.249554:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301669376 00000100:00100000:3.0:1788813093.249592:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301669888 00000100:00100000:3.0:1788813093.249605:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301669888 00000100:00100000:3.0:1788813093.249618:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301669504 00000100:00100000:3.0:1788813093.249620:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301669504 00000100:00100000:3.0:1788813093.249630:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301669760 00000100:00100000:3.0:1788813093.249632:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301669760 00000100:00100000:3.0:1788813093.249643:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 159 00000100:00100000:3.0:1788813093.249649:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:2397:x1875706301669376:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813093.249678:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:2397:x1875706301669376:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813093.249684:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 159 00000100:00100000:3.0:1788813093.249694:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 160 00000100:00100000:3.0:1788813093.249698:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301669888:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813093.249716:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301669888:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 17us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813093.249720:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 160 00000100:00100000:3.0:1788813093.249729:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 161 00000100:00100000:3.0:1788813093.249734:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301669504:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813093.249767:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301669504:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 33us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813093.249773:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 161 00000100:00100000:3.0:1788813093.249786:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 162 00000100:00100000:3.0:1788813093.249792:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301669760:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813093.253754:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301669248 00000100:00100000:3.0:1788813093.253768:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301669248 00000100:00100000:3.0:1788813093.254437:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 321 00000100:00100000:3.0:1788813093.254448:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2397:x1875706301669248:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813093.254551:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2397:x1875706301669248:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 105us (5243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813093.254567:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 321 00000100:00080000:3.0:1788813093.254617:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813093.254622:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813093.254625:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813093.254652:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301669760:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 4860us (5305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813093.254660:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 162 00010000:00010000:0.0:1788813093.732084:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813094.756316:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813095.780700:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813096.311457:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813096.311479:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eaef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313270400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813096.311543:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813096.314889:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313270400 00000100:00100000:1.0:1788813096.314898:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313270400 00000100:00100000:1.0:1788813096.314969:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788813096.314982:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fd7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313270400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788813096.315010:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813096.315075:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fd7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313270400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (3531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813096.315083:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788813096.315253:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313270528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813096.315295:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788813096.315332:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813096.315342:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313270528 00000100:00100000:1.0:1788813096.315346:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313270528 00000100:00100000:1.0:1788813096.315479:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788813096.315487:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313270528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813096.315498:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813096.315528:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313270528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813096.315535:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788813096.315565:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788813096.315630:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943460380 x1875706313270528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813096.315647:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313270528:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788813096.315676:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a6eaef480 x1875706313270400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813096.315688:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eaef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313270400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813096.804213:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313270656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813096.804276:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813096.804382:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313270656 00000100:00100000:2.0:1788813096.804390:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313270656 00000100:00100000:2.0:1788813096.804439:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788813096.804447:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313270656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813096.804494:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788813096.804538:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313270656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813096.804545:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788813096.804594:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313270656:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788813096.804733:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788813096.832244:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788813096.833254:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788813096.833273:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1788813096.833301:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702bf4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833314:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702bf4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833322:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702bf4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833328:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813096.833333:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702bf4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833341:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702bf4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833357:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6274d149 (ffff948a455ee400) 00010000:00010000:2.0:1788813096.833360:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813096.833365:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702bf4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833371:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702bf4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833395:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702c09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833402:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702c09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833408:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702c09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833412:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813096.833415:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702c09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833422:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702c09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833428:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff948942fffa00) 00010000:00010000:2.0:1788813096.833431:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813096.833434:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702c09 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833440:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702c09 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833455:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833461:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c72 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833466:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833475:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813096.833478:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833484:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c72 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833492:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6274d149 (ffff948a455ee400) 00010000:00010000:2.0:1788813096.833494:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813096.833496:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c72 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833503:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702c72 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833515:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff702c8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833520:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff702c8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833536:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff702c8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833541:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813096.833544:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff702c8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833550:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff702c8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833574:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff948a74a15500) 00010000:00010000:2.0:1788813096.833577:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813096.833580:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff702c8e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813096.833586:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff702c8e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813096.836461:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313270784:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788813096.836544:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813096.836627:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313270784 00000100:00100000:3.0:1788813096.836635:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313270784 00000100:00100000:3.0:1788813096.836683:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788813096.836691:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313270784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788813096.836713:0:10066:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1788813096.836753:0:10066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f1f23, atime: 0x6a9f1f23, ctime: 0x6a9f1f23, blocks: 0x0 00010000:00010000:3.0:1788813096.840037:0:10066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff702c9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813096.840062:0:10066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=249s v=(0 0) 00010000:00010000:3.0:1788813096.840067:0:10066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813096.840074:0:10066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff702c9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813096.840093:0:10066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff702c9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813096.840105:0:10066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff702c9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813096.840113:0:10066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff702c9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813096.840137:0:10066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813096.841052:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813096.841061:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff702c9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813096.841071:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656800 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813096.841076:0:7900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff702c9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813096.841085:0:7900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff702c9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813096.841104:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff702c9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813096.841113:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff702c9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813096.841131:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813096.841132:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813096.841140:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813096.842641:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3625:x1875706313270784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5943us (6090us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788813096.842662:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788813096.842698:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788813096.853555:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948943460380/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788813096.853580:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313270784:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788813098.974334:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813098.974361:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813098.974380:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813098.974395:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813098.974864:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301670016 00000100:00100000:2.0:1788813098.974874:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301670016 00000100:00100000:2.0:1788813098.974925:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 322 00000100:00100000:2.0:1788813098.974949:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301670016:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813098.975011:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301670016:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 78us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813098.975028:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 322 00000100:00100000:3.0:1788813098.978144:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813098.978178:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813098.978213:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301670400 00000100:00100000:0.0:1788813098.978220:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301670400 00000100:00100000:0.0:1788813098.978280:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 64 00000100:00100000:0.0:1788813098.978288:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301670400:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813098.978339:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301670400:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 52us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813098.978355:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 64 00000100:00100000:1.0:1788813098.987390:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313270912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813098.987467:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813098.987521:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813098.987529:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313270912 00000100:00100000:1.0:1788813098.987536:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313270912 00000100:00100000:1.0:1788813098.987583:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788813098.987591:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1875706313270912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813098.987613:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813098.987651:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1875706313270912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813098.987658:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788813098.987698:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313270912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813098.999061:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301670272 00000100:00100000:2.0:1788813098.999076:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301670272 00000100:00080000:2.0:1788813098.999352:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813098.999369:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313271168:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.000674:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813099.000715:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313271680:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.000754:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813099.000772:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313272192:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.000792:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813099.000806:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313272704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813099.000823:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813099.000998:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788813099.001007:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313271040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813099.001040:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813099.001056:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313271552:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.001076:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813099.001091:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313272064:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.001107:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813099.001120:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313272576:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.001134:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813099.001156:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313271296:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.001175:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813099.001183:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313271808:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.001199:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813099.001206:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313272320:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.001220:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813099.001229:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788813099.001233:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313271424:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.001247:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813099.001260:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313271936:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.001276:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813099.001284:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313272448:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.001299:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813099.001318:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313271680 00000100:00100000:2.0:1788813099.001323:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313271680 00000100:00100000:2.0:1788813099.001353:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313271040 00000100:00100000:2.0:1788813099.001360:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313271040 00000100:00100000:2.0:1788813099.001372:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313271424 00000100:00100000:2.0:1788813099.001374:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313271424 00000100:00100000:2.0:1788813099.001385:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788813099.001392:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313271680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.007393:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313271680:12345-0@lo:400:kworker.0 Request processed in 5991us (6641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.007918:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788813099.007966:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788813099.007977:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3628:x1875706313271040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788813099.008001:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788813099.008042:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3628:x1875706313271040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (7001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.008048:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788813099.008060:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788813099.008065:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313271424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.008094:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313271424:12345-0@lo:400:kworker.0 Request processed in 29us (6845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.008099:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788813099.008122:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313272192 00000100:00100000:2.0:1788813099.008128:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313272192 00000100:00100000:2.0:1788813099.008162:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313272064 00000100:00100000:2.0:1788813099.008164:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313272064 00000100:00100000:2.0:1788813099.008175:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313272576 00000100:00100000:2.0:1788813099.008177:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313272576 00000100:00100000:2.0:1788813099.008200:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788813099.008206:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313272192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.008235:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313272192:12345-0@lo:400:kworker.0 Request processed in 30us (7443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.008252:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788813099.008262:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788813099.008267:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313272064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.008290:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313272064:12345-0@lo:400:kworker.0 Request processed in 23us (7182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.008295:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788813099.008303:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788813099.008309:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313272576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.008328:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313272576:12345-0@lo:400:kworker.0 Request processed in 20us (7194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.008333:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788813099.008348:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313272704 00000100:00100000:2.0:1788813099.008351:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313272704 00000100:00100000:2.0:1788813099.008372:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788813099.008378:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313272704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813099.008389:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813099.008429:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313272704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (7604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.008435:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788813099.008463:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813099.008466:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813099.008494:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313271424:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.008537:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301670528 00000100:00100000:2.0:1788813099.008552:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301670528 00000100:00100000:2.0:1788813099.008565:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301670144 00000100:00100000:2.0:1788813099.008567:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301670144 00000100:00100000:2.0:1788813099.008585:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301670656 00000100:00100000:2.0:1788813099.008587:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301670656 00000100:00100000:2.0:1788813099.008597:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313271552 00000100:00100000:2.0:1788813099.008599:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313271552 00000100:00100000:2.0:1788813099.008607:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313271296 00000100:00100000:2.0:1788813099.008609:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313271296 00000100:00100000:2.0:1788813099.008617:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313271808 00000100:00100000:2.0:1788813099.008620:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313271808 00000100:00100000:2.0:1788813099.008629:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313272320 00000100:00100000:2.0:1788813099.008631:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313272320 00000100:00100000:2.0:1788813099.008640:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313271936 00000100:00100000:2.0:1788813099.008642:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313271936 00000100:00100000:2.0:1788813099.008650:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313272448 00000100:00100000:2.0:1788813099.008652:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313272448 00000100:00100000:2.0:1788813099.008666:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 163 00000100:00100000:2.0:1788813099.008672:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301670272:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813099.008716:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301670272:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 44us (34355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.008722:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 163 00000100:00100000:2.0:1788813099.008733:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 164 00000100:00100000:2.0:1788813099.008738:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301670528:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813099.008771:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301670528:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 33us (34391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.008776:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 164 00000100:00100000:2.0:1788813099.008786:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 165 00000100:00100000:2.0:1788813099.008791:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301670144:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813099.008809:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301670144:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 18us (34414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.008823:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 165 00000100:00100000:2.0:1788813099.008833:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 166 00000100:00100000:2.0:1788813099.008839:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301670656:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813099.008858:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301670656:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 20us (30680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.008863:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 166 00000100:00100000:2.0:1788813099.008871:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788813099.008876:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313271552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.008903:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313271552:12345-0@lo:400:kworker.0 Request processed in 26us (7825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.008908:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788813099.008918:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788813099.008922:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313271296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.008962:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313271296:12345-0@lo:400:kworker.0 Request processed in 40us (7787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.008969:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788813099.008978:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788813099.008983:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313271808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.009004:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313271808:12345-0@lo:400:kworker.0 Request processed in 21us (7804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.009009:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788813099.009017:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788813099.009022:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313272320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.009051:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313272320:12345-0@lo:400:kworker.0 Request processed in 29us (7830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.009056:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788813099.009066:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788813099.009071:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313271936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.009090:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313271936:12345-0@lo:400:kworker.0 Request processed in 20us (7813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.009095:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788813099.009103:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788813099.009108:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313272448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.009129:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313272448:12345-0@lo:400:kworker.0 Request processed in 21us (7830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813099.009134:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1788813099.009146:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813099.009148:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788813099.009259:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894334ea00 x1875706313271936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813099.009271:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313271936:0@lo:400:kworker.0 00010000:00080000:2.0:1788813099.009281:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894334c380 x1875706313272448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813099.009290:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313272448:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.009298:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313271296:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.009306:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313271808:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.009324:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313272320:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.009357:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313271040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813099.009366:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313271552:0@lo:400:kworker.0 00010000:00080000:2.0:1788813099.009376:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894334fb80 x1875706313272064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813099.009385:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313272064:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.009395:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313272576:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.009403:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313271680:0@lo:400:kworker.0 00010000:00080000:2.0:1788813099.009412:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894334ed80 x1875706313272192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813099.009420:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313272192:0@lo:400:kworker.0 00000100:00100000:2.0:1788813099.009430:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313272704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813099.017603:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313271168 00000100:00100000:0.0:1788813099.017619:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313271168 00000100:00100000:0.0:1788813099.017678:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788813099.017688:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3628:x1875706313271168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813099.017781:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3628:x1875706313271168:12345-0@lo:400:kworker.0 Request processed in 94us (17107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813099.017788:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788813099.017841:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313271168:0@lo:400:kworker.0 00010000:00010000:0.0:1788813100.006577:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813101.034174:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813101.414433:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eaef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313272832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813101.414516:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813101.414608:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813101.414616:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313272960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813101.414639:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813101.414793:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313272832 00000100:00100000:2.0:1788813101.414801:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313272832 00000100:00100000:2.0:1788813101.414868:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313272960 00000100:00100000:2.0:1788813101.414872:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313272960 00000100:00100000:2.0:1788813101.414889:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788813101.414907:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313272832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788813101.414960:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813101.415005:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313272832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813101.415012:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788813101.415043:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788813101.415050:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313272960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813101.415060:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813101.415085:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313272960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813101.415090:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788813101.415336:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813101.415366:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e05500 x1875706313272960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813101.415385:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313272960:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788813101.415396:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a6eaef480 x1875706313272832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813101.415405:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eaef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313272832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813101.931387:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313273088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813101.931460:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813101.933990:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313273088 00000100:00100000:3.0:1788813101.934005:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313273088 00000100:00100000:3.0:1788813101.934072:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788813101.934081:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313273088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788813101.934116:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788813101.934197:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313273088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (2736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813101.934204:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788813101.934315:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313273088:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788813102.052711:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788813102.952273:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1788813103.089705:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813103.523870:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813103.523918:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813103.523992:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813103.524013:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813103.524035:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813103.524059:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813103.524088:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301671040 00000100:00100000:0.0:1788813103.524098:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301671040 00000100:00100000:0.0:1788813103.524155:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301671296 00000100:00100000:0.0:1788813103.524159:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301671296 00000100:00100000:0.0:1788813103.524174:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301670912 00000100:00100000:0.0:1788813103.524177:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301670912 00000100:00100000:0.0:1788813103.524192:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301671424 00000100:00100000:0.0:1788813103.524195:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301671424 00000100:00100000:0.0:1788813103.524227:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 173 00000100:00100000:0.0:1788813103.524236:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301671040:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813103.524310:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301671040:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 74us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813103.524317:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 173 00000100:00100000:0.0:1788813103.524335:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 174 00000100:00100000:0.0:1788813103.524343:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301671296:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813103.524367:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301671296:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813103.524373:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 174 00000100:00100000:0.0:1788813103.524385:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 175 00000100:00100000:0.0:1788813103.524391:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301670912:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813103.524447:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301670912:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 57us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813103.524454:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 175 00000100:00100000:0.0:1788813103.524467:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 176 00000100:00100000:0.0:1788813103.524474:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301671424:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813103.524497:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301671424:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813103.524797:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301670784 00000100:00100000:2.0:1788813103.524803:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301670784 00000100:00100000:2.0:1788813103.524838:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 324 00000100:00100000:2.0:1788813103.524845:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301670784:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813103.524873:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301670784:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813103.524880:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 324 00000100:00100000:0.0:1788813103.524969:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 176 00000100:00100000:0.0:1788813103.524994:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301671168 00000100:00100000:0.0:1788813103.524998:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301671168 00000100:00100000:0.0:1788813103.525029:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 68 00000100:00100000:0.0:1788813103.525037:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301671168:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813103.525065:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301671168:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813103.525071:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 68 00000100:00080000:0.0:1788813103.525089:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813103.525094:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813103.525095:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1788813103.614784:0:13651:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788813104.108797:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813104.486601:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313273216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813104.486702:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813104.486965:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313273216 00000100:00100000:3.0:1788813104.486977:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313273216 00000100:00100000:3.0:1788813104.487074:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788813104.487086:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313273216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813104.487127:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813104.487196:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313273216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813104.487204:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788813104.487256:0:3628:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788813104.487263:0:3628:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff948943460380, transno 4294967301 00000100:00100000:3.0:1788813104.487304:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313273216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813104.489714:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313273728:0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.489791:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813104.489841:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313274240:0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.489869:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813104.489888:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313274752:0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.489908:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813104.489957:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788813104.489963:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313273600:0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.489995:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813104.490011:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313274112:0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.490032:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813104.490059:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313274624:0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.490079:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813104.490110:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313273728 00000100:00100000:3.0:1788813104.490118:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313273728 00000100:00100000:3.0:1788813104.490177:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313274112 00000100:00100000:3.0:1788813104.490180:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313274112 00000100:00100000:3.0:1788813104.490202:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313274624 00000100:00100000:3.0:1788813104.490204:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313274624 00000100:00100000:3.0:1788813104.490220:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788813104.490228:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313273728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.490280:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313273728:12345-0@lo:400:kworker.0 Request processed in 53us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813104.490287:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788813104.490304:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788813104.490329:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313274112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.490357:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313274112:12345-0@lo:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813104.490362:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788813104.490373:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788813104.490378:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313274624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.490402:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313274624:12345-0@lo:400:kworker.0 Request processed in 24us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813104.490407:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788813104.490424:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313274240 00000100:00100000:3.0:1788813104.490428:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313274240 00000100:00100000:3.0:1788813104.490454:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313274752 00000100:00100000:3.0:1788813104.490457:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313274752 00000100:00100000:3.0:1788813104.490477:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788813104.490483:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313274240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.490524:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313274240:12345-0@lo:400:kworker.0 Request processed in 41us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813104.490530:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788813104.490542:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788813104.490547:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313274752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.490586:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313274752:12345-0@lo:400:kworker.0 Request processed in 39us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813104.490592:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788813104.490614:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313273600 00000100:00100000:3.0:1788813104.490618:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313273600 00000100:00100000:3.0:1788813104.490645:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788813104.490651:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a74a80050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313273600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.490692:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a74a80050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313273600:12345-0@lo:400:kworker.0 Request processed in 42us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813104.490699:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788813104.491064:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313273600:0@lo:400:kworker.0 00010000:00080000:3.0:1788813104.491080:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894334d880 x1875706313274112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813104.491093:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313274112:0@lo:400:kworker.0 00010000:00080000:3.0:1788813104.491104:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894334c380 x1875706313274624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813104.491113:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313274624:0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.491124:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313273728:0@lo:400:kworker.0 00010000:00080000:3.0:1788813104.491134:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894334c700 x1875706313274240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813104.491143:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313274240:0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.491153:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313274752:0@lo:400:kworker.0 00000100:00080000:0.0:1788813104.492192:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813104.492200:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788813104.492203:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813104.492408:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313273344:0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.492473:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813104.492528:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313273856:0@lo:400:kworker.0 00000100:00100000:0.0:1788813104.496415:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313273344 00000100:00100000:0.0:1788813104.496436:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313273344 00000100:00100000:2.0:1788813104.496484:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813104.496558:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788813104.496565:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313274368:0@lo:400:kworker.0 00000100:00100000:0.0:1788813104.496576:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3625:x1875706313273344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.496635:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813104.496666:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313274880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813104.496684:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3625:x1875706313273344:12345-0@lo:400:kworker.0 Request processed in 112us (4207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813104.496695:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788813104.496702:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813104.496762:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313273344:0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.496801:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788813104.496974:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313274368 00000100:00100000:3.0:1788813104.496982:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313274368 00000100:00100000:3.0:1788813104.497034:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788813104.497054:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313274368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.504690:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313274368:12345-0@lo:400:kworker.0 Request processed in 7636us (8044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813104.504710:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788813104.504794:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313273856 00000100:00100000:3.0:1788813104.504807:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313273856 00000100:00100000:3.0:1788813104.504865:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313274880 00000100:00100000:3.0:1788813104.504868:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313274880 00000100:00100000:3.0:1788813104.504886:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788813104.504895:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313273856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813104.505006:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313273856:12345-0@lo:400:kworker.0 Request processed in 112us (8530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813104.505012:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788813104.505024:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788813104.505031:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313274880:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813104.509851:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313273472:0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.509962:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813104.510006:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313273984:0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.510030:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813104.510049:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313274496:0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.510087:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813104.510127:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313273856:0@lo:400:kworker.0 00010000:00080000:2.0:1788813104.510142:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894334dc00 x1875706313274368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813104.510154:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313274368:0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.510175:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813104.510189:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313275008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813104.510212:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813104.510278:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313273472 00000100:00100000:2.0:1788813104.510285:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313273472 00000100:00100000:2.0:1788813104.510323:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313273984 00000100:00100000:2.0:1788813104.510326:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313273984 00000100:00100000:2.0:1788813104.510342:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313274496 00000100:00100000:2.0:1788813104.510344:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313274496 00000100:00100000:2.0:1788813104.510357:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788813104.510364:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313273472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.510407:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313273472:12345-0@lo:400:kworker.0 Request processed in 43us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813104.510414:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788813104.510445:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788813104.510450:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313273984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.510479:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313273984:12345-0@lo:400:kworker.0 Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813104.510485:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788813104.510507:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788813104.510513:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313274496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.510540:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313274496:12345-0@lo:400:kworker.0 Request processed in 28us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813104.510546:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788813104.510567:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313275008 00000100:00100000:2.0:1788813104.510571:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313275008 00000100:00100000:2.0:1788813104.510596:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788813104.510601:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313275008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813104.510615:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813104.510645:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313275008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813104.510651:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788813104.510688:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313275008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813104.510782:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313273472:0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.510790:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313273984:0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.510797:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313274496:0@lo:400:kworker.0 00000100:00080000:2.0:1788813104.510843:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813104.510848:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00000024:3.0:1788813104.517420:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788813104.517586:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313274880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 12539us (20871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813104.517598:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788813104.517870:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313274880:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788813105.124514:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788813105.897242:0:13699:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3dfc0050 20000000:00000080:2.0:1788813105.897259:0:13699:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff948a7b611800 uarg=0000000000000000 20000000:01000000:2.0:1788813105.897301:0:13699:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788813105.897307:0:13699:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788813105.897312:0:13699:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788813105.897842:0:13700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788813105.898285:0:13699:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788813105.903521:0:13699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788813105.903639:0:13699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788813105.903661:0:13699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788813105.903681:0:13699:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788813105.903701:0:13699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948943657c00/0xf32533d6ff702ca3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.903733:0:13699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948943656c00/0xf32533d6ff702b29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729649 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.903745:0:13699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a44cdac00/0xf32533d6ff702b30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729650 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.903757:0:13699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff702b3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702b37 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.903776:0:13699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948943656e00/0xf32533d6ff702b4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702b45 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.903782:0:13699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948943657600/0xf32533d6ff702b5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702b53 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.903789:0:13699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948943657a00/0xf32533d6ff702b68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702b61 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.903796:0:13699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948943657c00/0xf32533d6ff702ca3 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.903845:0:13699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948943657a00/0xf32533d6ff702b68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702b61 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.903859:0:13699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948943657a00/0xf32533d6ff702b68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702b61 expref: 23 pid: 6487 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813105.903874:0:13699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875706313275136:0@lo:104: 00000100:00100000:3.0:1788813105.904173:0:13699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813105.904274:0:13699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948943657600/0xf32533d6ff702b5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702b53 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.904283:0:13699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948943657600/0xf32533d6ff702b5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702b53 expref: 23 pid: 6487 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813105.904291:0:13699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875706313275264:0@lo:104: 00000100:00100000:3.0:1788813105.904314:0:13699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813105.904422:0:13699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948943656e00/0xf32533d6ff702b4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702b45 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.904439:0:13699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948943656e00/0xf32533d6ff702b4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702b45 expref: 23 pid: 6486 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813105.904448:0:13699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875706313275392:0@lo:104: 00000100:00100000:3.0:1788813105.904473:0:13699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813105.904542:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313275136 00000100:00100000:1.0:1788813105.904645:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313275136 00000100:00100000:1.0:1788813105.904692:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313275264 00000100:00100000:1.0:1788813105.904696:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313275264 00000100:00100000:1.0:1788813105.904712:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788813105.904721:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943418850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:13699:x1875706313275136:12345-0@lo:104: 00010000:00010000:1.0:1788813105.904739:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a6fc09000/0xf32533d6ff702b61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702b68 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.904815:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813105.904820:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943418850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:13699:x1875706313275136:12345-0@lo:104: Request processed in 101us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813105.904827:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788813105.904868:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788813105.904873:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:13699:x1875706313275264:12345-0@lo:104: 00010000:00010000:1.0:1788813105.904881:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948943657400/0xf32533d6ff702b53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702b5a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.904909:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813105.904914:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:13699:x1875706313275264:12345-0@lo:104: Request processed in 42us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813105.904919:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1788813105.904960:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813105.904966:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a6fc09000/0xf32533d6ff702b61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702b68 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.904972:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813105.904976:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc09000/0xf32533d6ff702b61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702b68 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.904985:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a6fc09000/0xf32533d6ff702b61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702b68 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813105.904992:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc09000/0xf32533d6ff702b61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702b68 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813105.904997:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813105.905169:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a6fc09000/0xf32533d6ff702b61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702b68 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.905177:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788813105.905224:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313275520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813105.905257:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813105.905313:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a6fc09000/0xf32533d6ff702b61 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702b68 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.905321:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a6fc09000/0xf32533d6ff702b61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702b68 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.905333:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813105.905336:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948943657400/0xf32533d6ff702b53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702b5a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.905342:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657400 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813105.905345:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948943657400/0xf32533d6ff702b53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702b5a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.905353:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948943657400/0xf32533d6ff702b53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702b5a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813105.905359:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948943657400/0xf32533d6ff702b53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702b5a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813105.905364:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813105.905383:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948943657400/0xf32533d6ff702b53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702b5a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.905390:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813105.905462:0:13699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff702b3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff702b37 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.905472:0:13699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff702b3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff702b37 expref: 23 pid: 6486 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813105.905494:0:13699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875706313275776:0@lo:104: 00000100:00100000:3.0:1788813105.905518:0:13699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813105.905542:0:13699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a44cdac00/0xf32533d6ff702b30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729650 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.905568:0:13699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a44cdac00/0xf32533d6ff702b30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729650 expref: 12 pid: 6487 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813105.905579:0:13699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875706313275904:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813105.905634:0:13699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948943656c00/0xf32533d6ff702b29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729649 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.905642:0:13699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948943656c00/0xf32533d6ff702b29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729649 expref: 12 pid: 6488 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813105.905650:0:13699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875706313276032:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813105.905671:0:13699:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b5d4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813105.905699:0:13699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875706313275136:0@lo:104: 00000100:00100000:3.0:1788813105.905708:0:13699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875706313275264:0@lo:104: 00000100:00100000:0.0:1788813105.905771:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313275392 00000100:00100000:0.0:1788813105.905777:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313275392 00000100:00100000:0.0:1788813105.905800:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313275776 00000100:00100000:0.0:1788813105.905803:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313275776 00000100:00100000:0.0:1788813105.905816:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813105.905823:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:13699:x1875706313275392:12345-0@lo:104: 00010000:00010000:0.0:1788813105.905831:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff702b45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702b4c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.905886:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788813105.905892:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+4:13699:x1875706313275392:12345-0@lo:104: Request processed in 69us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813105.905898:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813105.905913:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788813105.905918:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:13699:x1875706313275776:12345-0@lo:104: 00010000:00010000:0.0:1788813105.905925:0:6477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff702b37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702b3e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.905964:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788813105.905969:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+3:13699:x1875706313275776:12345-0@lo:104: Request processed in 52us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813105.905975:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788813105.905994:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313275520 00000100:00100000:0.0:1788813105.906004:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313275520 00010000:00010000:0.0:1788813105.906022:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948943657a00/0xf32533d6ff702b68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702b61 expref: 24 pid: 6487 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813105.906043:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788813105.906049:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313275520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813105.906058:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813105.906063:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948943657a00/0xf32533d6ff702b68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702b61 expref: 24 pid: 6487 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.906073:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948943657a00/0xf32533d6ff702b68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702b61 expref: 24 pid: 6487 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.906086:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948943657a00/0xf32533d6ff702b68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702b61 expref: 24 pid: 6487 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.906098:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813105.906165:0:13699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875706313275392:0@lo:104: 00000100:00100000:3.0:1788813105.906172:0:13699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875706313275776:0@lo:104: 00010000:00010000:1.0:1788813105.906420:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948943657400/0xf32533d6ff702b53 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702b5a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.906438:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948943657400/0xf32533d6ff702b53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702b5a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.906447:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813105.906450:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff702b45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702b4c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.906455:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdbe00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813105.906458:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff702b45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702b4c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.906466:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff702b45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702b4c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813105.906472:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff702b45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702b4c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813105.906488:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813105.906517:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff702b45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702b4c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.906523:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813105.906538:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff702b45 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702b4c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.906544:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a44cdbe00/0xf32533d6ff702b45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702b4c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.906565:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813105.906573:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff702b37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff702b3e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.906579:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdaa00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813105.906582:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff702b37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff702b3e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.906589:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff702b37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff702b3e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813105.906595:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff702b37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff702b3e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813105.906600:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813105.906614:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff702b37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702b3e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.906620:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813105.906627:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff702b37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702b3e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.906632:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a44cdaa00/0xf32533d6ff702b37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff702b3e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.906645:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813105.906647:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813105.906648:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813105.906655:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813105.906666:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313275648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813105.906695:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813105.906733:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313276160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813105.906763:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813105.906784:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813105.906789:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313276288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813105.906808:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813105.906872:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313275648 00000100:00100000:1.0:1788813105.906877:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313275648 00010000:00010000:1.0:1788813105.906895:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948943657600/0xf32533d6ff702b5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702b53 expref: 24 pid: 6487 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813105.906909:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313276160 00000100:00100000:1.0:1788813105.906911:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313276160 00010000:00010000:1.0:1788813105.906922:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948943656e00/0xf32533d6ff702b4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702b45 expref: 25 pid: 6486 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813105.906948:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313276288 00000100:00100000:1.0:1788813105.906951:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313276288 00010000:00010000:1.0:1788813105.906962:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff702b3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702b37 expref: 26 pid: 6486 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813105.906974:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788813105.906980:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943463480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+26:3628:x1875706313275648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813105.906987:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813105.906991:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948943657600/0xf32533d6ff702b5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702b53 expref: 26 pid: 6487 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.907001:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948943657600/0xf32533d6ff702b5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702b53 expref: 26 pid: 6487 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.907010:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948943657600/0xf32533d6ff702b5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702b53 expref: 26 pid: 6487 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.907030:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813105.907060:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943463480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+25:3628:x1875706313275648:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813105.907066:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788813105.907079:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788813105.907085:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3625:x1875706313276160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813105.907091:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813105.907096:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948943656e00/0xf32533d6ff702b4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702b45 expref: 24 pid: 6486 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.907103:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948943656e00/0xf32533d6ff702b4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702b45 expref: 24 pid: 6486 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.907113:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948943656e00/0xf32533d6ff702b4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702b45 expref: 24 pid: 6486 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.907121:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813105.907143:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:3625:x1875706313276160:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813105.907148:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788813105.907160:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788813105.907165:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943460a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:3625:x1875706313276288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813105.907172:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813105.907176:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff702b3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff702b37 expref: 22 pid: 6486 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.907185:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff702b3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff702b37 expref: 22 pid: 6486 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.907200:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff702b3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff702b37 expref: 22 pid: 6486 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.907207:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813105.907226:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943460a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:3625:x1875706313276288:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813105.907232:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788813105.907269:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313275648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813105.907289:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313276288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813105.907295:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313276160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813105.907558:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:3627:x1875706313275520:12345-0@lo:103:ldlm_bl.0 Request processed in 1496us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813105.907565:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:0.0:1788813105.907585:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813105.907673:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313275520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813105.914501:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813105.915615:0:13699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875706313275904:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813105.915627:0:13699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875706313276032:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813105.915665:0:13699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948943657c00/0xf32533d6ff702ca3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813105.917283:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301671552 00000100:00100000:1.0:1788813105.917294:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301671552 00010000:00010000:1.0:1788813105.917343:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a44cdac00/0xf32533d6ff702b30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729650 expref: 13 pid: 6487 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813105.919504:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 50 00000100:00100000:1.0:1788813105.919523:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:612bc516-9aee-451d-b7c0-359fff7db073+13:2396:x1875706301671552:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813105.919544:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813105.923041:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a44cdac00/0xf32533d6ff702b30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729650 expref: 13 pid: 6487 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.923064:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a44cdac00/0xf32533d6ff702b30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729650 expref: 13 pid: 6487 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.923086:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cdac00/0xf32533d6ff702b30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729650 expref: 13 pid: 6487 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813105.923129:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813105.923198:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:612bc516-9aee-451d-b7c0-359fff7db073+12:2396:x1875706301671552:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 3682us (8704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813105.923209:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 50 00000100:00100000:2.0:1788813105.938854:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813105.940574:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301671680 00000100:00100000:0.0:1788813105.940589:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301671680 00010000:00010000:0.0:1788813105.940637:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948943656c00/0xf32533d6ff702b29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729649 expref: 12 pid: 6488 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813105.940682:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 51 00000100:00100000:0.0:1788813105.940693:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:612bc516-9aee-451d-b7c0-359fff7db073+12:2396:x1875706301671680:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813105.940709:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813105.940729:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948943656c00/0xf32533d6ff702b29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729649 expref: 12 pid: 6488 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.940741:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948943656c00/0xf32533d6ff702b29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729649 expref: 12 pid: 6488 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.940759:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948943656c00/0xf32533d6ff702b29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729649 expref: 12 pid: 6488 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.940777:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948943657c00/0xf32533d6ff702ca3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.940785:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948943657c00/0xf32533d6ff702ca3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.940801:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948943657c00/0xf32533d6ff702ca3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.940809:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948943657c00/0xf32533d6ff702ca3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.940816:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948943657c00/0xf32533d6ff702ca3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.940823:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948943657c00/0xf32533d6ff702ca3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.940829:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657c00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813105.940834:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948943657c00/0xf32533d6ff702ca3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.940842:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948943657c00/0xf32533d6ff702ca3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.994230:0:13699:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948943657c00/0xf32533d6ff702ca3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813105.994249:0:13699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948943657c00/0xf32533d6ff702ca3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.995857:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948943657c00/0xf32533d6ff702ca3 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.995875:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948943657c00/0xf32533d6ff702ca3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813105.995897:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813105.996011:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:612bc516-9aee-451d-b7c0-359fff7db073+11:2396:x1875706301671680:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 55314us (57160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813105.996022:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 51 00010000:00010000:3.0:1788813106.187518:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813106.532294:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313276416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813106.532371:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813106.532587:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313276416 00000100:00100000:3.0:1788813106.532596:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313276416 00000100:00100000:3.0:1788813106.532664:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788813106.532674:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313276416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788813106.532705:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813106.532770:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313276416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813106.532777:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1788813106.532829:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943488000 x1875706313276416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813106.532849:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313276416:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788813106.533030:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813106.533755:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813106.533768:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313276544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813106.533810:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813106.533900:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313276544 00000100:00100000:2.0:1788813106.533905:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313276544 00000100:00100000:2.0:1788813106.533987:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788813106.533996:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313276544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813106.534012:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813106.534051:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313276544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813106.534058:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788813106.534120:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788813106.534177:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894334f480 x1875706313276544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813106.534192:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313276544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813107.044181:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313276672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813107.044288:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813107.044580:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313276672 00000100:00100000:0.0:1788813107.044590:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313276672 00000100:00100000:0.0:1788813107.044663:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788813107.044674:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313276672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813107.044709:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788813107.044766:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313276672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813107.044773:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788813107.045012:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313276672:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788813107.174960:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788813107.349395:0:13748:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdee2a3470 20000000:00000080:1.0:1788813107.349415:0:13748:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff948943618000 uarg=0000000000000000 20000000:01000000:1.0:1788813107.349458:0:13748:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788813107.349478:0:13748:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788813107.349483:0:13748:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1788813107.349926:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1788813107.350153:0:13748:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1788813107.350234:0:13748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1788813107.350261:0:13748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1788813107.350274:0:13748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1788813107.350284:0:13748:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788813107.350304:0:13748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff702caa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813107.350319:0:13748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff702caa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813107.350330:0:13748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff702caa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813107.350336:0:13748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff702caa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813107.350354:0:13748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff702caa lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813107.350361:0:13748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff702caa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813107.350367:0:13748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813107.350371:0:13748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff702caa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813107.350381:0:13748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff702caa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813107.350393:0:13748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff702caa lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813107.350401:0:13748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff702caa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813107.350407:0:13748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f9200/0xf32533d6ff702caa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813107.754138:0:6492:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788813107.754146:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a7b522000 from 7 10000000:01000000:3.0:1788813107.754152:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788813107.754199:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813107.754211:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813107.754223:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813107.754251:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313276800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813107.754318:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813107.754361:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942dab840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813107.758190:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313276800 00000100:00100000:0.0:1788813107.758210:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313276800 00000100:00100000:0.0:1788813107.758291:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788813107.758314:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:6492:x1875706313276800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813107.758334:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813107.758370:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a821e4000/0xf32533d6ff702cb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702cb1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813107.758411:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e4000/0xf32533d6ff702cb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702cb1 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813107.758425:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a821e4000/0xf32533d6ff702cb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702cb1 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813107.758435:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4000, rc 0) 00000100:00100000:0.0:1788813107.760572:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313276800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2263us (6245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813107.760582:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788813107.760874:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313276800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813107.760897:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702cb8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813107.760910:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702cb8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813107.761021:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313276928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813107.761072:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813107.761109:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942dab840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813107.762248:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313276928 00000100:00100000:0.0:1788813107.762258:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313276928 00000100:00100000:0.0:1788813107.762333:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788813107.762343:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313276928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813107.762574:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313276928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813107.762581:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788813107.762629:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313276928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813107.762669:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943754a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313277056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813107.762710:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813107.762735:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46415480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813107.762749:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313277056 00000100:00100000:0.0:1788813107.762752:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313277056 00000100:00100000:0.0:1788813107.762788:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788813107.762795:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313277056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813107.762886:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313277056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813107.762892:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788813107.762950:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943754a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313277056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813107.763147:0:13762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943754a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13762:1875706313277184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813107.763176:0:13762:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813107.763192:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313277184 00000100:00100000:0.0:1788813107.763195:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313277184 00000100:00100000:0.0:1788813107.763213:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788813107.763218:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:13762:x1875706313277184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813107.763278:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:13762:x1875706313277184:12345-0@lo:502:llog_process_th.0 Request processed in 58us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813107.763284:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788813107.763313:0:13762:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46415600 going to sleep for 11 seconds 00000100:00100000:0.0:1788813107.763324:0:13762:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943754a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13762:1875706313277184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788813107.763341:0:13762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813107.763363:0:13762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813107.763366:0:13762:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788813107.763373:0:13762:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a7b522000 00000020:00000080:0.0:1788813107.763375:0:13762:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813107.763429:0:13762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813107.763432:0:13762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813107.763433:0:13762:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788813107.763436:0:13762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813107.763438:0:13762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813107.763440:0:13762:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788813107.763449:0:13762:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a7b522000 00000020:00000080:0.0:1788813107.763451:0:13762:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788813107.776675:0:13762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943754a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13762:1875706313277312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813107.776786:0:13762:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813107.776824:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313277312 00000100:00100000:0.0:1788813107.776832:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313277312 00000100:00100000:0.0:1788813107.776878:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788813107.776887:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:13762:x1875706313277312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813107.777015:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:13762:x1875706313277312:12345-0@lo:502:llog_process_th.0 Request processed in 128us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813107.777023:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788813107.777072:0:13762:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46415600 going to sleep for 11 seconds 00000100:00100000:0.0:1788813107.777096:0:13762:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943754a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13762:1875706313277312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788813107.777129:0:13762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813107.777136:0:13762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813107.777138:0:13762:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788813107.777144:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788813107.777204:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788813107.777221:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813107.777230:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702cb8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813107.777242:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702cb8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813107.777251:0:6492:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788813107.777254:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a7b74e800 from 7 10000000:01000000:0.0:1788813107.777256:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813107.777285:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813107.777300:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813107.777310:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813107.777324:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943754a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313277440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813107.777350:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813107.777366:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46415600 going to sleep for 11 seconds 00000100:00100000:0.0:1788813107.777380:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313277440 00000100:00100000:0.0:1788813107.777384:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313277440 00000100:00100000:0.0:1788813107.777407:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788813107.777413:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:6492:x1875706313277440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813107.777421:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813107.777432:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a821e4200/0xf32533d6ff702cc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702cbf expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813107.777452:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e4200/0xf32533d6ff702cc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702cbf expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813107.782711:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a821e4200/0xf32533d6ff702cc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702cbf expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813107.782730:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4200, rc 0) 00000100:00100000:0.0:1788813107.784782:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313277440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 7362us (7423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813107.784793:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788813107.786588:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943754a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313277440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813107.786617:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702cc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813107.786632:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702cc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813107.786722:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313277568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813107.786775:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813107.790570:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813107.805177:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313277568 00000100:00100000:0.0:1788813107.805195:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313277568 00000100:00100000:0.0:1788813107.805432:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788813107.805442:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313277568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813107.807657:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313277568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2209us (20874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813107.807669:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788813108.003002:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313277568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813108.003081:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943754e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313277696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813108.007541:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813108.007606:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a64231000 going to sleep for 11 seconds 00000100:00100000:0.0:1788813108.007726:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313277696 00000100:00100000:0.0:1788813108.007735:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313277696 00000100:00100000:0.0:1788813108.007778:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788813108.007786:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313277696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813108.007927:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313277696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813108.007952:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788813108.008023:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943754e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313277696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813108.021065:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13765:1875706313277824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813108.021162:0:13765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813108.021309:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313277824 00000100:00100000:1.0:1788813108.021317:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313277824 00000100:00100000:1.0:1788813108.021362:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788813108.021370:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:13765:x1875706313277824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813108.021521:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:13765:x1875706313277824:12345-0@lo:502:llog_process_th.0 Request processed in 151us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813108.021536:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788813108.021587:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489434ac0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813108.021609:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13765:1875706313277824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813108.021635:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813108.021644:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813108.021645:0:13765:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788813108.021652:0:13765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a7b74e800 00000020:00000080:1.0:1788813108.021654:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788813108.021699:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813108.021977:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813108.021980:0:13765:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788813108.021983:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813108.021987:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813108.021988:0:13765:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788813108.021991:0:13765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a7b74e800 00000020:00000080:1.0:1788813108.021994:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788813108.027599:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13765:1875706313277952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813108.027776:0:13765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813108.027819:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313277952 00000100:00100000:1.0:1788813108.027827:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313277952 00000100:00100000:1.0:1788813108.027872:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788813108.027883:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:13765:x1875706313277952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813108.031713:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:13765:x1875706313277952:12345-0@lo:502:llog_process_th.0 Request processed in 3825us (3929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813108.031726:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788813108.031903:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489434ac0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813108.031947:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13765:1875706313277952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813108.031992:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813108.032000:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813108.032002:0:13765:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788813108.032008:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788813108.032082:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788813108.032104:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813108.032114:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702cc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813108.032125:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702cc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813108.032136:0:6492:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813108.032139:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a61047800 from 7 10000000:01000000:1.0:1788813108.032142:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813108.032173:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813108.032181:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813108.032190:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813108.032211:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313278080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813108.032246:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813108.032267:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489434ac0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813108.032282:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313278080 00000100:00100000:1.0:1788813108.032288:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313278080 00000100:00100000:1.0:1788813108.032323:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788813108.032341:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:6492:x1875706313278080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813108.032354:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813108.032367:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff702cd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702ccd expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813108.032388:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff702cd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702ccd expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813108.032399:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff702cd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702ccd expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813108.032407:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9000, rc 0) 00000100:00100000:1.0:1788813108.032436:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313278080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813108.032442:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788813108.044009:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313278080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813108.044037:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702cd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813108.044050:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702cd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813108.044135:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313278208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813108.044194:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813108.044225:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489434ac0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813108.044244:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313278208 00000100:00100000:1.0:1788813108.044250:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313278208 00000100:00100000:1.0:1788813108.044290:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788813108.044313:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313278208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813108.044434:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313278208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813108.044442:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788813108.044596:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313278208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813108.044623:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313278336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813108.044661:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813108.044675:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489434ac0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813108.044687:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313278336 00000100:00100000:1.0:1788813108.044690:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313278336 00000100:00100000:1.0:1788813108.044712:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788813108.044718:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313278336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813108.044804:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313278336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813108.044811:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788813108.044849:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313278336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813108.045135:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13766:1875706313278464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813108.045168:0:13766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813108.045185:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313278464 00000100:00100000:1.0:1788813108.045189:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313278464 00000100:00100000:1.0:1788813108.045209:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788813108.045216:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:13766:x1875706313278464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813108.045279:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:13766:x1875706313278464:12345-0@lo:502:llog_process_th.0 Request processed in 63us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813108.045293:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788813108.045322:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489434ac6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813108.045334:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13766:1875706313278464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813108.045353:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813108.045362:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813108.045364:0:13766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788813108.045372:0:13766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a61047800 00000020:00000080:1.0:1788813108.045374:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788813108.045422:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813108.047826:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813108.047833:0:13766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788813108.047843:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813108.047849:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813108.047850:0:13766:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788813108.047855:0:13766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a61047800 00000020:00000080:1.0:1788813108.047858:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788813108.048152:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13766:1875706313278592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813108.048219:0:13766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813108.048252:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313278592 00000100:00100000:1.0:1788813108.048258:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313278592 00000100:00100000:1.0:1788813108.048305:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788813108.048315:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:13766:x1875706313278592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813108.048415:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:13766:x1875706313278592:12345-0@lo:502:llog_process_th.0 Request processed in 103us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813108.048423:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788813108.049520:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489434ac6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813108.049551:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13766:1875706313278592:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813108.049592:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813108.049599:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813108.049602:0:13766:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788813108.049607:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788813108.050823:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788813108.050852:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813108.050864:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702cd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813108.050877:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702cd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813108.050889:0:6492:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813108.050892:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a60186000 from 7 10000000:01000000:2.0:1788813108.050895:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813108.050966:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813108.050985:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813108.050995:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813108.051016:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313278720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813108.051070:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813108.051098:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813108.052534:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313278720 00000100:00100000:1.0:1788813108.052544:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313278720 00000100:00100000:1.0:1788813108.052608:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788813108.052619:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:6492:x1875706313278720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813108.052635:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813108.052650:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff702ce2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff702cdb expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813108.052676:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff702ce2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff702cdb expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813108.052689:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff702ce2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff702cdb expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813108.052697:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8000, rc 0) 00000100:00100000:1.0:1788813108.052765:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313278720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813108.052773:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788813108.052839:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313278720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813108.052857:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702ce2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813108.052868:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702ce2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813108.052970:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313278848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813108.053014:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813108.053041:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313278848 00000100:00100000:1.0:1788813108.053046:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313278848 00000100:00100000:2.0:1788813108.053053:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813108.053076:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788813108.053083:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313278848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813108.053196:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313278848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813108.053212:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788813108.054060:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313278848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813108.054091:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313278976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813108.054131:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813108.054161:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788813108.054201:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313278976 00000100:00100000:0.0:1788813108.054206:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313278976 00000100:00100000:0.0:1788813108.054243:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788813108.054250:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313278976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813108.054331:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:6492:x1875706313278976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813108.054346:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788813108.054829:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:064264df-8ee4-4cbf-a8c5-6a62aca32881:6492:1875706313278976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813108.056113:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943754e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13767:1875706313279104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813108.056167:0:13767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813108.057076:0:13767:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a612eef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813108.065287:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313279104 00000100:00100000:2.0:1788813108.065302:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313279104 00000100:00100000:2.0:1788813108.065361:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788813108.065371:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:13767:x1875706313279104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813108.065554:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:13767:x1875706313279104:12345-0@lo:502:llog_process_th.0 Request processed in 184us (9386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813108.065562:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788813108.065632:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943754e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13767:1875706313279104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788813108.065666:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813108.065675:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813108.065677:0:13767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788813108.065684:0:13767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a60186000 00000020:00000080:2.0:1788813108.065687:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813108.072749:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813108.072765:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813108.072767:0:13767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788813108.072785:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813108.072790:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813108.072791:0:13767:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788813108.072796:0:13767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a60186000 00000020:00000080:2.0:1788813108.072798:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788813108.072887:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13767:1875706313279232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813108.072966:0:13767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813108.073032:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313279232 00000100:00100000:2.0:1788813108.073041:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313279232 00000100:00100000:2.0:1788813108.073086:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788813108.073094:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:13767:x1875706313279232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813108.073219:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:13767:x1875706313279232:12345-0@lo:502:llog_process_th.0 Request processed in 126us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813108.073227:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788813108.073279:0:13767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813108.073299:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:064264df-8ee4-4cbf-a8c5-6a62aca32881:13767:1875706313279232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788813108.073323:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813108.073327:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813108.073328:0:13767:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788813108.073332:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788813108.073393:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788813108.073414:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813108.073424:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702ce2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813108.073434:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702ce2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788813108.078170:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788813108.092405:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788813108.124920:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813108.125124:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301671808 00000100:00100000:0.0:1788813108.125135:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301671808 00000100:00100000:0.0:1788813108.125192:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 346 00000100:00100000:0.0:1788813108.125212:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+11:6158:x1875706301671808:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813108.125230:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813108.125249:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a821e5200/0xf32533d6ff702ce9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a072969d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813108.125277:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e5200/0xf32533d6ff702ce9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072969d expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813108.125290:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a821e5200/0xf32533d6ff702ce9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072969d expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813108.125298:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e5200, rc 0) 00000100:00100000:0.0:1788813108.125352:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+12:6158:x1875706301671808:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 Request processed in 152us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813108.125359:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 346 00000100:00100000:0.0:1788813108.144019:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813108.144902:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301671936 00000100:00100000:2.0:1788813108.144914:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301671936 00000100:00100000:2.0:1788813108.144998:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 347 00000100:00100000:2.0:1788813108.145009:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+12:6158:x1875706301671936:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813108.145150:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+12:6158:x1875706301671936:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 Request processed in 142us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813108.145158:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 347 00000100:00100000:2.0:1788813108.158390:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813108.158606:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301672064 00000100:00100000:3.0:1788813108.158618:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301672064 00000100:00100000:3.0:1788813108.158671:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 348 00000100:00100000:3.0:1788813108.158682:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+12:6158:x1875706301672064:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813108.158834:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+12:6158:x1875706301672064:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 Request processed in 153us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813108.158842:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 348 00000100:00100000:3.0:1788813108.182098:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813108.184077:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301672192 00000100:00100000:1.0:1788813108.184092:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301672192 00000100:00100000:1.0:1788813108.184147:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 349 00000100:00100000:1.0:1788813108.184157:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+12:10763:x1875706301672192:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813108.184325:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+12:10763:x1875706301672192:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 168us (2235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813108.184333:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 349 00000100:00100000:3.0:1788813108.201089:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813108.201265:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301672320 00000100:00100000:2.0:1788813108.201276:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301672320 00000100:00100000:2.0:1788813108.201329:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 350 00000100:00100000:2.0:1788813108.201340:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+12:10763:x1875706301672320:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813108.201488:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+12:10763:x1875706301672320:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 149us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813108.201496:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 350 00010000:00010000:0.0:1788813108.206750:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813108.220524:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813108.220611:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301672448 00000100:00100000:0.0:1788813108.220623:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301672448 00000100:00100000:0.0:1788813108.220690:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 351 00000100:00100000:0.0:1788813108.220699:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+12:6158:x1875706301672448:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813108.220715:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813108.220733:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a821e4a00/0xf32533d6ff702cf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a07296a4 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813108.220760:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a821e4a00/0xf32533d6ff702cf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296a4 expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813108.220772:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a821e4a00/0xf32533d6ff702cf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296a4 expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813108.220781:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4a00, rc 0) 00000100:00100000:0.0:1788813108.220843:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61298450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:6158:x1875706301672448:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 Request processed in 144us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813108.220850:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 351 00000100:00100000:1.0:1788813108.231502:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813108.231654:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301672576 00000100:00100000:0.0:1788813108.231665:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301672576 00000100:00100000:0.0:1788813108.231724:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 352 00000100:00100000:0.0:1788813108.231734:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:6158:x1875706301672576:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813108.231900:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:6158:x1875706301672576:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 Request processed in 167us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813108.231909:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 352 00000100:00100000:3.0:1788813108.248985:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813108.249170:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301672704 00000100:00100000:2.0:1788813108.249180:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301672704 00000100:00100000:2.0:1788813108.249243:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 353 00000100:00100000:2.0:1788813108.249253:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:6158:x1875706301672704:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813108.256169:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:6158:x1875706301672704:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 Request processed in 6895us (7171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813108.256186:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 353 00000100:00100000:3.0:1788813108.268734:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813108.268915:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301672832 00000100:00100000:0.0:1788813108.268926:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301672832 00000100:00100000:0.0:1788813108.269008:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 354 00000100:00100000:0.0:1788813108.269017:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:10766:x1875706301672832:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813108.269170:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:10766:x1875706301672832:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 153us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813108.269177:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 354 00000100:00100000:3.0:1788813108.272196:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813108.282540:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301672960 00000100:00100000:2.0:1788813108.282554:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301672960 00000100:00100000:3.0:1788813108.284201:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 355 00000100:00100000:3.0:1788813108.284213:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:10766:x1875706301672960:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788813108.284368:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:10766:x1875706301672960:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 157us (12179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813108.284375:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 355 00000100:00100000:3.0:1788813108.707905:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813108.708006:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813108.708031:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813108.708048:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301673344 00000100:00100000:0.0:1788813108.708058:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301673344 00000100:00100000:3.0:1788813108.708063:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813108.708109:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813108.708120:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:0.0:1788813108.708130:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301673344:12345-192.168.202.13@tcp:400:kworker.0 00000100:00080000:3.0:1788813108.708148:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813108.708214:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301673344:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 84us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813108.708221:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:2.0:1788813108.708392:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301673088 00000100:00100000:2.0:1788813108.708403:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301673088 00000100:00100000:2.0:1788813108.708464:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301673600 00000100:00100000:2.0:1788813108.708468:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301673600 00000100:00100000:2.0:1788813108.708482:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301673216 00000100:00100000:2.0:1788813108.708484:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301673216 00000100:00100000:2.0:1788813108.708496:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301673472 00000100:00100000:2.0:1788813108.708498:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301673472 00000100:00100000:2.0:1788813108.708511:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 183 00000100:00100000:2.0:1788813108.708518:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301673088:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813108.708562:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301673088:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 45us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813108.708569:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 183 00000100:00100000:2.0:1788813108.708583:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 184 00000100:00100000:2.0:1788813108.708589:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301673600:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813108.708613:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301673600:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 25us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813108.708619:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 184 00000100:00100000:2.0:1788813108.708631:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 185 00000100:00100000:2.0:1788813108.708637:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301673216:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813108.708659:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301673216:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 23us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813108.708665:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 185 00000100:00100000:2.0:1788813108.708675:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 186 00000100:00100000:2.0:1788813108.708680:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301673472:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813108.708699:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301673472:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 19us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813108.708711:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 186 00000100:00080000:0.0:1788813108.709505:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788813108.709511:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788813109.092701:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788813109.156692:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788813109.227685:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813109.605659:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313279488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813109.605746:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813109.605824:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eaece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313280000:0@lo:400:kworker.0 00000100:00100000:0.0:1788813109.605849:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813109.605872:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313280512:0@lo:400:kworker.0 00000100:00100000:0.0:1788813109.605914:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813109.606008:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eaec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313279744:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.606036:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813109.606050:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313279360:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.606059:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313280256:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.606078:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813109.606081:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813109.606094:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313280768:0@lo:400:kworker.0 00000100:00100000:2.0:1788813109.606099:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eaed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313279872:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.606111:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813109.606123:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313279360 00000100:00100000:2.0:1788813109.606130:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313279360 00000100:00100000:1.0:1788813109.606139:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313279616:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.606159:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813109.606174:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313280128:0@lo:400:kworker.0 00000100:00100000:2.0:1788813109.606183:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788813109.606191:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313279360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.606192:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813109.606205:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313280640:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.606223:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813109.606234:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313281152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813109.606236:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313279360:12345-0@lo:400:kworker.0 Request processed in 39us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813109.606243:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788813109.606260:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813109.606273:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313279488 00000100:00100000:2.0:1788813109.606276:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313279488 00000100:00100000:1.0:1788813109.606301:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313280000 00000100:00100000:1.0:1788813109.606304:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313280000 00000100:00100000:2.0:1788813109.606305:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313281152 00000100:00100000:2.0:1788813109.606306:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313281152 00000100:00100000:2.0:1788813109.606318:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788813109.606324:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313279488:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813109.606324:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313279744 00000100:00100000:1.0:1788813109.606326:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313279744 00000100:00100000:1.0:1788813109.606337:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788813109.606342:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313280000:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788813109.606343:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813109.606371:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313280000:12345-0@lo:400:kworker.0 Request processed in 28us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813109.606377:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788813109.606383:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313279488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813109.606389:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788813109.606389:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788813109.606394:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313279744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813109.606399:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788813109.606404:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313281152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813109.606412:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813109.606430:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313279744:12345-0@lo:400:kworker.0 Request processed in 36us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813109.606432:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313281152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 29us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813109.606436:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788813109.606453:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788813109.606463:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313280256 00000100:00100000:1.0:1788813109.606466:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313280256 00000100:00100000:2.0:1788813109.606469:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313280768 00000100:00100000:2.0:1788813109.606472:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313280768 00000100:00100000:2.0:1788813109.606485:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313279616 00000100:00100000:1.0:1788813109.606485:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313280128 00000100:00100000:2.0:1788813109.606487:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313279616 00000100:00100000:1.0:1788813109.606487:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313280128 00000100:00100000:1.0:1788813109.606497:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313280640 00000100:00100000:1.0:1788813109.606499:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313280640 00000100:00100000:2.0:1788813109.606500:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788813109.606505:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313280768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.606510:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788813109.606547:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313280768:12345-0@lo:400:kworker.0 Request processed in 41us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813109.606553:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788813109.606565:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788813109.606571:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313279616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813109.606598:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313279616:12345-0@lo:400:kworker.0 Request processed in 28us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813109.606603:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788813109.606614:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788813109.606619:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313280128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813109.606644:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313280128:12345-0@lo:400:kworker.0 Request processed in 25us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813109.606649:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788813109.606659:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788813109.606664:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313280640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813109.606688:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313280640:12345-0@lo:400:kworker.0 Request processed in 24us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813109.606693:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788813109.606742:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813109.606761:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313280384:0@lo:400:kworker.0 00000100:00100000:2.0:1788813109.606782:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813109.606797:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313280896:0@lo:400:kworker.0 00000100:00100000:2.0:1788813109.606815:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813109.606842:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313279360:0@lo:400:kworker.0 00000100:00100000:2.0:1788813109.606864:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313280512 00000100:00100000:2.0:1788813109.606868:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313280512 00000100:00100000:1.0:1788813109.606869:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313280256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813109.606891:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313280384 00000100:00100000:2.0:1788813109.606894:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313280384 00000100:00100000:1.0:1788813109.606901:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313280256:12345-0@lo:400:kworker.0 Request processed in 386us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813109.606905:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313280896 00000100:00100000:2.0:1788813109.606907:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313280896 00000100:00100000:1.0:1788813109.606908:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788813109.606916:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788813109.606917:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313279872 00000100:00100000:1.0:1788813109.606919:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313279872 00000100:00100000:2.0:1788813109.606921:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313280512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.606961:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788813109.606967:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313279872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813109.606978:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313280512:12345-0@lo:400:kworker.0 Request processed in 57us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813109.606984:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788813109.606996:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788813109.606997:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313279872:12345-0@lo:400:kworker.0 Request processed in 30us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813109.607002:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313280384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.607002:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788813109.607027:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313279616:0@lo:400:kworker.0 00000100:00100000:3.0:1788813109.607768:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788813109.607778:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313280896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813109.612515:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313281024:0@lo:400:kworker.0 00000100:00100000:2.0:1788813109.612648:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313280384:12345-0@lo:400:kworker.0 Request processed in 5642us (5860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813109.612661:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788813109.612724:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313281280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813109.612772:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813109.612830:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eaec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313279744:0@lo:400:kworker.0 00010000:00080000:2.0:1788813109.612847:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943524700 x1875706313280256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813109.612872:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313280256:0@lo:400:kworker.0 00010000:00080000:2.0:1788813109.612887:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943525180 x1875706313280768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813109.612895:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313280768:0@lo:400:kworker.0 00000100:00100000:2.0:1788813109.612986:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313281280 00000100:00100000:2.0:1788813109.612993:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313281280 00000100:00100000:2.0:1788813109.613034:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788813109.613041:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313281280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788813109.613076:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788813109.613145:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313281280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813109.613151:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788813109.613179:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313281280:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788813109.613220:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813109.613226:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813109.613228:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788813109.613230:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813109.613264:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eaed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313279872:0@lo:400:kworker.0 00010000:00080000:2.0:1788813109.613277:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943524380 x1875706313280384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813109.613285:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313280384:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.617975:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313280128:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.617997:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313280640:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.618018:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313281152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813109.623707:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313280896:12345-0@lo:400:kworker.0 Request processed in 15921us (16880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813109.623735:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788813109.624179:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313280896:0@lo:400:kworker.0 00000100:00100000:0.0:1788813109.627818:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813109.627896:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313279488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813109.627909:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eaece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313280000:0@lo:400:kworker.0 00010000:00080000:0.0:1788813109.627958:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943524000 x1875706313280512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813109.627981:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313280512:0@lo:400:kworker.0 00000100:00100000:2.0:1788813109.628077:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313281024 00000100:00100000:2.0:1788813109.628084:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313281024 00000100:00100000:2.0:1788813109.628136:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788813109.628145:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313281024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813109.628201:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313281024:12345-0@lo:400:kworker.0 Request processed in 58us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813109.628208:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788813109.629691:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313281024:0@lo:400:kworker.0 00010000:00010000:1.0:1788813110.244894:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813111.268465:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813111.652274:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813111.652296:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313281408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813111.652296:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813111.652310:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313281536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813111.658169:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813111.661676:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813111.682742:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313281408 00000100:00100000:3.0:1788813111.682757:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313281408 00000100:00100000:2.0:1788813111.684035:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313281536 00000100:00100000:2.0:1788813111.684134:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313281536 00000100:00100000:2.0:1788813111.684271:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788813111.684281:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313281536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813111.684320:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813111.684397:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313281536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (22727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813111.684404:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:2.0:1788813111.684474:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943524000 x1875706313281536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813111.684494:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313281536:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788813111.684646:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813111.686589:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788813111.686601:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313281408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788813111.686623:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788813111.686692:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813111.686703:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313281408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (28541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813111.686711:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1788813111.686825:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7fd93480 x1875706313281408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813111.686843:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313281408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813112.170216:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813112.170239:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313281664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813112.170313:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813112.170431:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313281664 00000100:00100000:0.0:1788813112.170440:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313281664 00000100:00100000:0.0:1788813112.170494:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788813112.170503:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313281664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813112.170537:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788813112.170581:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313281664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813112.170588:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788813112.171245:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313281664:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788813112.292525:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813113.318639:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813113.866347:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813113.866415:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813113.866457:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813113.866504:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813113.866521:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813113.866712:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301673984 00000100:00100000:0.0:1788813113.866723:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301673984 00000100:00100000:0.0:1788813113.866794:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301673856 00000100:00100000:0.0:1788813113.866798:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301673856 00000100:00100000:0.0:1788813113.866813:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301674240 00000100:00100000:0.0:1788813113.866816:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301674240 00000100:00100000:0.0:1788813113.866827:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301674368 00000100:00100000:0.0:1788813113.866829:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301674368 00000100:00100000:0.0:1788813113.866844:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 193 00000100:00100000:0.0:1788813113.866853:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301673984:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813113.867150:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301673984:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 297us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813113.867158:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 193 00000100:00100000:0.0:1788813113.867176:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 194 00000100:00100000:0.0:1788813113.867190:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301673856:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813113.867218:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301673856:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813113.867224:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 194 00000100:00100000:0.0:1788813113.867235:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 195 00000100:00100000:0.0:1788813113.867242:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301674240:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813113.867265:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301674240:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813113.867272:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 195 00000100:00100000:0.0:1788813113.867283:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 196 00000100:00100000:0.0:1788813113.867289:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301674368:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813113.867310:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301674368:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 21us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813113.867316:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 196 00000100:00080000:0.0:1788813113.867332:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813113.867336:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788813113.868012:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813113.868183:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301674112 00000100:00100000:2.0:1788813113.868189:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301674112 00000100:00100000:2.0:1788813113.868231:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 27 00000100:00100000:2.0:1788813113.868239:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2395:x1875706301674112:12345-192.168.202.13@tcp:9:kworker.0 00000020:00000080:2.0:1788813113.868260:0:10066:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702c17 00000100:00080000:2.0:1788813113.868269:0:10066:0:(import.c:65:import_set_state_nolock()) ffff948941922000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788813113.868313:0:10066:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788813113.869183:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788813113.869204:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813113.869622:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+2:2395:x1875706301674112:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 1380us (3067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813113.869632:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 27 00000100:00100000:1.0:1788813113.873328:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301673728 00000100:00100000:1.0:1788813113.873343:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301673728 00000100:00100000:1.0:1788813113.873425:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 357 00000100:00100000:1.0:1788813113.873456:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2399:x1875706301673728:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813113.873546:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2399:x1875706301673728:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 93us (7209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813113.873565:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 357 00010000:00010000:3.0:1788813114.340885:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813114.724507:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313281920:0@lo:400:kworker.0 00000100:00100000:2.0:1788813114.724725:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313282176:0@lo:400:kworker.0 00000100:00100000:1.0:1788813114.724921:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313281792:0@lo:400:kworker.0 00000100:00100000:3.0:1788813114.725171:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313282048:0@lo:400:kworker.0 00000100:00100000:2.0:1788813114.737470:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813114.737537:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313282176 00000100:00100000:2.0:1788813114.737546:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313282176 00000100:00100000:2.0:1788813114.737596:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788813114.737605:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313282176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813114.737665:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313282176:12345-0@lo:400:kworker.0 Request processed in 60us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813114.737672:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788813114.737752:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313282176:0@lo:400:kworker.0 00000100:00100000:2.0:1788813114.737763:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313282688:0@lo:400:kworker.0 00000100:00100000:2.0:1788813114.737799:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813114.737821:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313282688 00000100:00100000:2.0:1788813114.737837:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313282688 00000100:00100000:2.0:1788813114.737877:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788813114.737883:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313282688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813114.737922:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313282688:12345-0@lo:400:kworker.0 Request processed in 40us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813114.737928:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1788813114.737969:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e06680 x1875706313282688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813114.737979:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313282688:0@lo:400:kworker.0 00000100:00100000:2.0:1788813114.737987:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313283200:0@lo:400:kworker.0 00000100:00100000:2.0:1788813114.738007:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813114.738058:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313283200 00000100:00100000:2.0:1788813114.738061:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313283200 00000100:00100000:2.0:1788813114.738082:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788813114.738087:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313283200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813114.738115:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313283200:12345-0@lo:400:kworker.0 Request processed in 28us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813114.738120:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788813114.738136:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813114.738139:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813114.738153:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313283200:0@lo:400:kworker.0 00000100:00100000:3.0:1788813114.744704:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813114.745018:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813114.745066:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313281920 00000100:00100000:0.0:1788813114.745078:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313281920 00000100:00100000:0.0:1788813114.745147:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788813114.745158:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313281920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813114.745227:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313281920:12345-0@lo:400:kworker.0 Request processed in 71us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813114.745255:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788813114.745503:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313281920:0@lo:400:kworker.0 00000100:00100000:0.0:1788813114.745517:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313282432:0@lo:400:kworker.0 00000100:00100000:0.0:1788813114.745551:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813114.745657:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313282432 00000100:00100000:3.0:1788813114.745661:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313282432 00000100:00100000:3.0:1788813114.745699:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788813114.745707:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313282432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813114.745738:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313282432:12345-0@lo:400:kworker.0 Request processed in 33us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813114.745743:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:3.0:1788813114.745781:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813114.746289:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313282560:0@lo:400:kworker.0 00000100:00100000:3.0:1788813114.746320:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813114.746347:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313282560 00000100:00100000:3.0:1788813114.746351:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313282560 00000100:00100000:3.0:1788813114.746379:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788813114.746385:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313282560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813114.746428:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313282560:12345-0@lo:400:kworker.0 Request processed in 44us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813114.746434:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:3.0:1788813114.746447:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788813114.746688:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e04700 x1875706313282560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813114.746701:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313282560:0@lo:400:kworker.0 00000100:00100000:0.0:1788813114.746709:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1875706313283072:0@lo:400:kworker.0 00000100:00100000:0.0:1788813114.747028:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813114.747051:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313283072 00000100:00100000:0.0:1788813114.747055:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313283072 00000100:00100000:0.0:1788813114.747082:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788813114.747088:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875706313283072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813114.747116:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875706313283072:12345-0@lo:400:kworker.0 Request processed in 28us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813114.747123:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:0.0:1788813114.747138:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788813114.747155:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489433a7800 x1875706313283072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813114.747165:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1875706313283072:0@lo:400:kworker.0 00000100:00100000:0.0:1788813114.747172:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313283584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813114.747197:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813114.747218:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313282048 00000100:00100000:0.0:1788813114.747229:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313282048 00000100:00100000:0.0:1788813114.747253:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313283584 00000100:00100000:0.0:1788813114.747255:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313283584 00000100:00100000:0.0:1788813114.747266:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788813114.747271:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3627:x1875706313282048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813114.747306:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3627:x1875706313282048:12345-0@lo:400:kworker.0 Request processed in 35us (2613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813114.747312:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788813114.747322:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788813114.747327:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313283584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788813114.747355:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788813114.747384:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313283584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813114.747392:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788813114.747444:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313283584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813114.747452:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313283712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813114.747479:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313282048:0@lo:400:kworker.0 00000100:00100000:0.0:1788813114.747510:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313282432:0@lo:400:kworker.0 00000100:00100000:0.0:1788813114.747519:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313282944:0@lo:400:kworker.0 00000100:00100000:2.0:1788813114.747538:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813114.747558:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813114.747594:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313283712 00000100:00100000:2.0:1788813114.747604:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313283712 00000100:00100000:2.0:1788813114.747661:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788813114.747686:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313283712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813114.747732:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813114.747795:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313283712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813114.747802:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788813114.748090:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313283712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813114.748305:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813114.749334:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313282304:0@lo:400:kworker.0 00000100:00100000:1.0:1788813114.749386:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813114.749426:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313282816:0@lo:400:kworker.0 00000100:00100000:1.0:1788813114.749451:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813114.749470:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313283328:0@lo:400:kworker.0 00000100:00100000:1.0:1788813114.749517:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813114.749546:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813114.749604:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313281792 00000100:00100000:3.0:1788813114.749629:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313281792 00000100:00100000:1.0:1788813114.749639:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313283456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813114.749710:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813114.749757:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313282304 00000100:00100000:1.0:1788813114.749761:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313282304 00000100:00100000:1.0:1788813114.749809:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788813114.749818:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313282304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813114.749875:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313282304:12345-0@lo:400:kworker.0 Request processed in 57us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813114.749881:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788813114.749921:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313282304:0@lo:400:kworker.0 00000100:00100000:3.0:1788813114.750003:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788813114.750011:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3625:x1875706313281792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813114.750109:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3625:x1875706313281792:12345-0@lo:400:kworker.0 Request processed in 99us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813114.750116:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788813114.750186:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313282816 00000100:00100000:3.0:1788813114.750190:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313282816 00000100:00100000:3.0:1788813114.750223:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313283328 00000100:00100000:3.0:1788813114.750226:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313283328 00000100:00100000:3.0:1788813114.750261:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788813114.750268:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313282816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813114.750298:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313282816:12345-0@lo:400:kworker.0 Request processed in 31us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813114.750318:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788813114.750330:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788813114.750336:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313283328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813114.750364:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313283328:12345-0@lo:400:kworker.0 Request processed in 28us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813114.750369:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788813114.750384:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813114.750387:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813114.750417:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313283456 00000100:00100000:3.0:1788813114.750421:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313283456 00000100:00100000:3.0:1788813114.750444:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788813114.750450:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313283456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813114.750464:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813114.750494:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313283456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813114.750500:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788813114.774028:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313283456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813114.774046:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313281792:0@lo:400:kworker.0 00010000:00080000:0.0:1788813114.774060:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e05f80 x1875706313282816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813114.774086:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313282816:0@lo:400:kworker.0 00000100:00100000:0.0:1788813114.774118:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313283328:0@lo:400:kworker.0 00000100:00100000:1.0:1788813114.774330:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313282944 00000100:00100000:1.0:1788813114.774345:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313282944 00000100:00100000:1.0:1788813114.774435:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788813114.774445:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313282944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813114.774529:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313282944:12345-0@lo:400:kworker.0 Request processed in 86us (26973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813114.774536:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788813114.774629:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313282944:0@lo:400:kworker.0 00000100:00080000:0.0:1788813114.774811:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788813115.376556:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813116.388126:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813116.774424:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813116.774449:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313283840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813116.774519:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813116.774608:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813116.774621:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313283968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813116.774740:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813116.775318:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313283840 00000100:00100000:0.0:1788813116.775327:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313283840 00000100:00100000:0.0:1788813116.775396:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313283968 00000100:00100000:0.0:1788813116.775400:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313283968 00000100:00100000:0.0:1788813116.775418:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788813116.775427:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313283840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788813116.775465:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813116.775514:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313283840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813116.775521:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788813116.775538:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788813116.775544:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313283968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813116.775553:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813116.775578:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313283968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813116.775584:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788813116.775707:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788813116.775742:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489433a6a00 x1875706313283968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813116.775773:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313283968:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788813116.775805:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489433a5c00 x1875706313283840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813116.775827:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313283840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813117.284692:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313284096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813117.284784:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813117.285007:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313284096 00000100:00100000:1.0:1788813117.285016:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313284096 00000100:00100000:1.0:1788813117.285081:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788813117.285092:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313284096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788813117.285126:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788813117.303228:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313284096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 18127us (18432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813117.303242:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788813117.312199:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313284096:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788813117.414880:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813118.437404:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813118.849435:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813118.849496:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813118.849559:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813118.849603:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813118.857109:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301674624 00000100:00100000:1.0:1788813118.857127:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301674624 00000100:00100000:1.0:1788813118.857203:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301674880 00000100:00100000:1.0:1788813118.857206:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301674880 00000100:00100000:1.0:1788813118.857237:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 203 00000100:00100000:1.0:1788813118.857247:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301674624:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813118.857340:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301674624:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 93us (7919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813118.857348:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 203 00000100:00100000:1.0:1788813118.857375:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 204 00000100:00100000:1.0:1788813118.857383:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301674880:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813118.857410:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301674880:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (7916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813118.857424:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 204 00000100:00080000:1.0:1788813118.857448:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813118.866089:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301674496 00000100:00100000:1.0:1788813118.866103:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301674496 00000100:00100000:1.0:1788813118.866174:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 359 00000100:00100000:1.0:1788813118.866184:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2399:x1875706301674496:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813118.866254:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2399:x1875706301674496:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 71us (16694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813118.866261:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 359 00000100:00100000:3.0:1788813118.875816:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813118.875915:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301674752 00000100:00100000:0.0:1788813118.875949:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301674752 00000100:00100000:0.0:1788813118.876018:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301675008 00000100:00100000:0.0:1788813118.876023:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301675008 00000100:00100000:0.0:1788813118.876070:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 205 00000100:00100000:0.0:1788813118.876081:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301674752:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813118.876167:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301674752:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 87us (26562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813118.876190:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 205 00000100:00100000:0.0:1788813118.876208:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 206 00000100:00100000:0.0:1788813118.876215:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301675008:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813118.876244:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301675008:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813118.876252:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 206 00000100:00080000:0.0:1788813118.876269:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1788813119.335047:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788813119.396657:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788813119.461744:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813119.846536:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813119.846559:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313284224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813119.846648:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813119.847239:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313284224 00000100:00100000:0.0:1788813119.847248:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313284224 00000100:00100000:0.0:1788813119.847307:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788813119.847317:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313284224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813119.847357:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813119.847412:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313284224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813119.847419:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788813119.847547:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313284608:0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.847579:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813119.847620:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313285120:0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.847644:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813119.847663:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313285632:0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.847685:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813119.847731:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313284224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813119.847747:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788813119.847760:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313284736:0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.847786:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813119.847801:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313285248:0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.847821:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813119.847836:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313285760:0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.847855:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813119.847879:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313284608 00000100:00100000:0.0:1788813119.847884:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313284608 00000100:00100000:0.0:1788813119.847908:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788813119.847914:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313284608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.847982:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313284608:12345-0@lo:400:kworker.0 Request processed in 67us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813119.847989:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788813119.848015:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313285120 00000100:00100000:0.0:1788813119.848031:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313285120 00000100:00100000:0.0:1788813119.848375:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788813119.848383:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313285120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.848418:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313285120:12345-0@lo:400:kworker.0 Request processed in 36us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813119.848424:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788813119.848442:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313285632 00000100:00100000:0.0:1788813119.848446:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313285632 00000100:00100000:0.0:1788813119.848471:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788813119.848478:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313285632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.848507:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313285632:12345-0@lo:400:kworker.0 Request processed in 30us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813119.848523:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788813119.848541:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313284736 00000100:00100000:0.0:1788813119.848545:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313284736 00000100:00100000:0.0:1788813119.848569:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313285248 00000100:00100000:0.0:1788813119.848572:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313285248 00000100:00100000:0.0:1788813119.848589:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313285760 00000100:00100000:0.0:1788813119.848592:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313285760 00000100:00080000:1.0:1788813119.848844:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813119.848850:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813119.848852:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813119.848884:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788813119.848894:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313284736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813119.848950:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313284736:12345-0@lo:400:kworker.0 Request processed in 39us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813119.848967:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788813119.848982:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788813119.848989:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313285248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813119.849017:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313285248:12345-0@lo:400:kworker.0 Request processed in 29us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813119.849024:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788813119.849072:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313284736:0@lo:400:kworker.0 00000100:00100000:1.0:1788813119.849084:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313285248:0@lo:400:kworker.0 00000100:00100000:1.0:1788813119.849102:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313284608:0@lo:400:kworker.0 00000100:00100000:1.0:1788813119.849111:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313285120:0@lo:400:kworker.0 00010000:00080000:1.0:1788813119.849122:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489432c7b80 x1875706313285632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813119.849132:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313285632:0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.851950:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788813119.852201:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313284352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813119.852261:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813119.852296:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313284864:0@lo:400:kworker.0 00000100:00100000:3.0:1788813119.852317:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813119.852335:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313285376:0@lo:400:kworker.0 00000100:00100000:3.0:1788813119.852382:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813119.852405:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313285888:0@lo:400:kworker.0 00000100:00100000:3.0:1788813119.852428:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813119.852444:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788813119.852451:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313284480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813119.852474:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813119.852492:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313284992:0@lo:400:kworker.0 00000100:00100000:3.0:1788813119.852511:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813119.852521:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313285504:0@lo:400:kworker.0 00000100:00100000:3.0:1788813119.852541:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813119.852559:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313286016:0@lo:400:kworker.0 00000100:00100000:3.0:1788813119.852576:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813119.852638:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313285504 00000100:00100000:3.0:1788813119.852645:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313285504 00000100:00100000:3.0:1788813119.852673:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313286016 00000100:00100000:3.0:1788813119.852676:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313286016 00000100:00100000:3.0:1788813119.852694:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788813119.853813:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313285504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813119.853877:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313285504:12345-0@lo:400:kworker.0 Request processed in 1176us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813119.853884:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788813119.853909:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788813119.853916:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313286016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.854270:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313285760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.854316:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313285760:12345-0@lo:400:kworker.0 Request processed in 2356us (6459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813119.854324:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788813119.854340:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313285376 00000100:00100000:0.0:1788813119.854356:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313285376 00000100:00100000:0.0:1788813119.854379:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313285888 00000100:00100000:0.0:1788813119.854382:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313285888 00000100:00100000:0.0:1788813119.854395:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313284992 00000100:00100000:0.0:1788813119.854397:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313284992 00000100:00100000:0.0:1788813119.854410:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788813119.854416:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313285376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.854446:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313285376:12345-0@lo:400:kworker.0 Request processed in 30us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813119.854452:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788813119.854463:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788813119.854469:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313285888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.854495:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313285888:12345-0@lo:400:kworker.0 Request processed in 27us (2066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813119.854501:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788813119.854523:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788813119.854528:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313284992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.854558:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313284992:12345-0@lo:400:kworker.0 Request processed in 29us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813119.854563:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788813119.854820:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313286016:12345-0@lo:400:kworker.0 Request processed in 43us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813119.854829:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788813119.854898:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788813119.854903:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813119.854905:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813119.854907:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813119.854976:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313285760:0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.855387:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313284480 00000100:00100000:0.0:1788813119.855392:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313284480 00000100:00100000:0.0:1788813119.855420:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788813119.855427:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313284480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788813119.855444:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813119.855481:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313284480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (3006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813119.855487:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788813119.855505:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313284352 00000100:00100000:0.0:1788813119.855509:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313284352 00000100:00100000:0.0:1788813119.855525:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313284864 00000100:00100000:0.0:1788813119.855528:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313284864 00000100:00100000:0.0:1788813119.855539:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788813119.855545:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1875706313284352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788813119.855568:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788813119.855615:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1875706313284352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (3353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813119.855621:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788813119.855633:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788813119.855639:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313284864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813119.855667:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313284864:12345-0@lo:400:kworker.0 Request processed in 28us (3349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813119.855684:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788813119.874521:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313284480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813119.874542:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313284992:0@lo:400:kworker.0 00010000:00080000:3.0:1788813119.874558:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489432c5500 x1875706313285504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813119.874569:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313285504:0@lo:400:kworker.0 00000100:00100000:3.0:1788813119.874579:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313286016:0@lo:400:kworker.0 00000100:00100000:3.0:1788813119.874593:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313284352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813119.874616:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313284864:0@lo:400:kworker.0 00010000:00080000:3.0:1788813119.874628:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489432c5f80 x1875706313285376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813119.874660:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313285376:0@lo:400:kworker.0 00010000:00080000:3.0:1788813119.874677:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a46542300 x1875706313285888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813119.874686:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313285888:0@lo:400:kworker.0 00000001:00100000:3.0:1788813119.893653:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000020:00000080:3.0:1788813119.893672:0:9483:0:(genops.c:885:class_export_put()) final put ffff948941927800/d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000020:00000080:0.0:1788813119.893802:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948941927800/d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 for lustre-OST0001 00000020:00000080:0.0:1788813119.893873:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948941922000 for lustre-OST0001 00010000:00010000:3.0:1788813120.484957:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813121.508868:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813121.894574:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813121.894611:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313286144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813121.894728:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813121.899263:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313286144 00000100:00100000:0.0:1788813121.899273:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313286144 00000100:00100000:0.0:1788813121.899347:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788813121.899358:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313286144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788813121.899388:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813121.899470:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313286144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (4743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813121.899477:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788813121.900691:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313286272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813121.900771:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788813121.900846:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489433a7800 x1875706313286144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813121.900867:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313286144:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788813121.901233:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813121.904696:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313286272 00000100:00100000:0.0:1788813121.904711:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313286272 00000100:00100000:0.0:1788813121.904781:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788813121.904791:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313286272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813121.904831:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813121.905024:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313286272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 234us (4252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813121.905031:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1788813121.905365:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a46540380 x1875706313286272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813121.905386:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313286272:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788813121.905671:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813122.406628:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813122.406652:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313286400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813122.406724:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813122.409003:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313286400 00000100:00100000:0.0:1788813122.409017:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313286400 00000100:00100000:0.0:1788813122.409102:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788813122.409113:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313286400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813122.409174:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788813122.409256:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313286400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (2532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813122.409263:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788813122.410605:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313286400:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788813122.533541:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813123.558392:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813123.975337:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813123.975403:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813123.975439:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813123.975474:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813123.975504:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813123.975570:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301675392 00000100:00100000:2.0:1788813123.975581:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301675392 00000100:00100000:2.0:1788813123.975643:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301675648 00000100:00100000:2.0:1788813123.975647:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301675648 00000100:00100000:2.0:1788813123.975660:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301675264 00000100:00100000:2.0:1788813123.975663:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301675264 00000100:00100000:2.0:1788813123.975675:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301675520 00000100:00100000:2.0:1788813123.975678:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301675520 00000100:00100000:2.0:1788813123.975696:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 213 00000100:00100000:2.0:1788813123.975706:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301675392:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813123.975782:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301675392:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 77us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813123.975790:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 213 00000100:00100000:2.0:1788813123.975832:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 214 00000100:00100000:2.0:1788813123.975840:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301675648:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813123.975866:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301675648:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813123.975873:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 214 00000100:00100000:2.0:1788813123.975885:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 215 00000100:00100000:2.0:1788813123.975891:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301675264:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813123.978042:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301675264:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 2139us (2555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813123.978056:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 215 00000100:00100000:2.0:1788813123.978097:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 216 00000100:00100000:2.0:1788813123.978108:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301675520:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813123.978166:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301675520:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 62us (2662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813123.978186:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 216 00000100:00080000:1.0:1788813123.979657:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813123.979666:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788813123.980295:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301675136 00000100:00100000:3.0:1788813123.980315:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301675136 00000100:00100000:3.0:1788813123.980379:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 361 00000100:00100000:3.0:1788813123.980388:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:2399:x1875706301675136:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813123.980457:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:2399:x1875706301675136:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 71us (5308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813123.980464:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 361 00010000:00010000:3.0:1788813124.582359:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813124.965129:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313286528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813124.965228:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813124.965345:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313286528 00000100:00100000:0.0:1788813124.965361:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313286528 00000100:00100000:0.0:1788813124.965498:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788813124.965510:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313286528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788813124.965548:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813124.965602:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313286528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813124.965610:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788813124.965681:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313286528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813124.966356:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313286784:0@lo:400:kworker.0 00000100:00100000:0.0:1788813124.966412:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813124.966451:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943643100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313287296:0@lo:400:kworker.0 00000100:00100000:0.0:1788813124.966479:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813124.966495:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313286784 00000100:00100000:0.0:1788813124.966499:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313287808:0@lo:400:kworker.0 00000100:00100000:2.0:1788813124.966502:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313286784 00000100:00100000:0.0:1788813124.966523:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813124.966540:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788813124.966543:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788813124.966547:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3628:x1875706313286784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813124.966549:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313286656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813124.966570:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813124.966591:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3628:x1875706313286784:12345-0@lo:400:kworker.0 Request processed in 45us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813124.966598:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788813124.966602:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313287168:0@lo:400:kworker.0 00000100:00100000:0.0:1788813124.966625:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813124.966647:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313287680:0@lo:400:kworker.0 00000100:00100000:0.0:1788813124.966668:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813124.966683:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313288192:0@lo:400:kworker.0 00000100:00100000:0.0:1788813124.966701:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813124.966731:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313286784:0@lo:400:kworker.0 00000100:00100000:3.0:1788813124.966752:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313287808 00000100:00100000:3.0:1788813124.966757:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313287808 00000100:00100000:3.0:1788813124.966788:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313287680 00000100:00100000:3.0:1788813124.966791:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313287680 00000100:00100000:3.0:1788813124.966804:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313288192 00000100:00100000:3.0:1788813124.966807:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313288192 00000100:00100000:3.0:1788813124.966820:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788813124.966849:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313287808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813124.966916:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788813124.966924:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313287680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813124.967654:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313286656 00000100:00100000:0.0:1788813124.967662:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313286656 00000100:00100000:0.0:1788813124.967760:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788813124.967769:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313286656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813124.967789:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788813124.967921:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813124.967927:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813124.967979:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7fd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313286912:0@lo:400:kworker.0 00000100:00100000:1.0:1788813124.968015:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813124.968046:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313287424:0@lo:400:kworker.0 00000100:00100000:1.0:1788813124.968068:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813124.969526:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313287808:12345-0@lo:400:kworker.0 Request processed in 2667us (2989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813124.969541:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788813124.969587:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788813124.969608:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313288192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813124.970271:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313287936:0@lo:400:kworker.0 00000100:00100000:1.0:1788813124.970353:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813124.970392:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788813124.970400:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313287040:0@lo:400:kworker.0 00000100:00100000:1.0:1788813124.970427:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813124.970466:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313287552:0@lo:400:kworker.0 00000100:00100000:1.0:1788813124.970489:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813124.970507:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313288064:0@lo:400:kworker.0 00000100:00100000:1.0:1788813124.970526:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813124.970563:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313287168 00000100:00100000:3.0:1788813124.970568:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313288192:12345-0@lo:400:kworker.0 Request processed in 974us (3866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813124.970572:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313287168 00000100:00100000:3.0:1788813124.970577:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788813124.970610:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313286912 00000100:00100000:1.0:1788813124.970613:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313286912 00000100:00100000:1.0:1788813124.970625:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313287424 00000100:00100000:1.0:1788813124.970628:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313287424 00000100:00100000:1.0:1788813124.970650:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313287936 00000100:00100000:1.0:1788813124.970653:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313287936 00000100:00100000:1.0:1788813124.970666:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313287552 00000100:00100000:1.0:1788813124.970668:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313287552 00000100:00100000:1.0:1788813124.970693:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313288064 00000100:00100000:1.0:1788813124.970697:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313288064 00000100:00100000:1.0:1788813124.970713:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788813124.970720:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313287168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813124.970760:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313287168:12345-0@lo:400:kworker.0 Request processed in 41us (4133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813124.970766:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788813124.970777:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313287296 00000100:00100000:1.0:1788813124.970777:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788813124.970782:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313287296 00000100:00100000:1.0:1788813124.970783:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313286912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813124.970807:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313287040 00000100:00100000:3.0:1788813124.970810:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313287040 00000100:00100000:1.0:1788813124.970813:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313286912:12345-0@lo:400:kworker.0 Request processed in 31us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813124.970819:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788813124.970823:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788813124.970828:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788813124.970829:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313287296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813124.970833:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313287424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813124.970866:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313287296:12345-0@lo:400:kworker.0 Request processed in 37us (4386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813124.970866:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313287424:12345-0@lo:400:kworker.0 Request processed in 33us (2797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813124.970872:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788813124.970878:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788813124.970883:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788813124.970888:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788813124.970889:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313287936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813124.970892:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313287040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813124.970915:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313287040:12345-0@lo:400:kworker.0 Request processed in 22us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813124.970920:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788813124.970924:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313287936:12345-0@lo:400:kworker.0 Request processed in 36us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813124.970929:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788813124.970956:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813124.970959:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788813124.970965:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313287552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813124.970966:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a8f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313288320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813124.970989:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813124.970990:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313287552:12345-0@lo:400:kworker.0 Request processed in 27us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813124.970996:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788813124.971006:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788813124.971008:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313288320 00000100:00100000:3.0:1788813124.971012:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313288320 00000100:00100000:1.0:1788813124.971012:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313288064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813124.971028:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788813124.971032:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313288320:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813124.971037:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313288064:12345-0@lo:400:kworker.0 Request processed in 26us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813124.971042:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000004:00000024:3.0:1788813124.971063:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00080000:1.0:1788813124.971066:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788813124.971069:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813124.971098:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313288320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813124.971104:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788813124.971148:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a8f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313288320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813124.971214:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313287040:0@lo:400:kworker.0 00010000:00080000:1.0:1788813124.971227:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943643480 x1875706313287552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813124.971238:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313287552:0@lo:400:kworker.0 00010000:00080000:1.0:1788813124.971259:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943641880 x1875706313288064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813124.971268:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313288064:0@lo:400:kworker.0 00000100:00100000:1.0:1788813124.971279:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7fd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313286912:0@lo:400:kworker.0 00000100:00100000:1.0:1788813124.971290:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313287424:0@lo:400:kworker.0 00000100:00100000:1.0:1788813124.971307:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313287936:0@lo:400:kworker.0 00000100:00100000:0.0:1788813124.972347:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313286656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4439us (5635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813124.972361:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788813124.972490:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313286656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813124.972508:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313287168:0@lo:400:kworker.0 00000100:00100000:2.0:1788813124.973537:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313287680:12345-0@lo:400:kworker.0 Request processed in 6607us (6861us total) trans 0 rc 0/0 00010000:00080000:1.0:1788813124.973545:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943642a00 x1875706313287680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813124.973551:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788813124.973560:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313287680:0@lo:400:kworker.0 00000100:00100000:1.0:1788813124.973576:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313288192:0@lo:400:kworker.0 00000100:00100000:1.0:1788813124.973590:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943643100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313287296:0@lo:400:kworker.0 00010000:00080000:1.0:1788813124.973602:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943640380 x1875706313287808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813124.973610:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313287808:0@lo:400:kworker.0 00010000:00010000:3.0:1788813125.605839:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813126.628526:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813127.012244:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813127.012291:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313288448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813127.012387:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813127.012603:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813127.012662:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313288576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813127.013325:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813127.013635:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313288448 00000100:00100000:0.0:1788813127.013646:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313288448 00000100:00100000:0.0:1788813127.013726:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313288576 00000100:00100000:0.0:1788813127.013729:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313288576 00000100:00100000:0.0:1788813127.013753:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788813127.013764:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313288448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813127.013805:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788813127.013954:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813127.014367:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788813127.014379:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313288576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788813127.014393:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813127.014450:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313288576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813127.014471:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788813127.014569:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313288448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 806us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813127.014577:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1788813127.014664:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a46543480 x1875706313288448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813127.014688:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313288448:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788813127.014772:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a46544380 x1875706313288576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813127.014786:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313288576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813127.526391:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313288704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813127.526501:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813127.526784:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313288704 00000100:00100000:2.0:1788813127.526795:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313288704 00000100:00100000:2.0:1788813127.526869:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788813127.526880:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313288704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813127.526951:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788813127.527106:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313288704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 227us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813127.527114:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788813127.527189:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313288704:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788813127.654458:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813128.678851:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813129.088417:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813129.088458:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813129.088483:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813129.088502:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813129.088521:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813129.088545:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301675776 00000100:00100000:3.0:1788813129.088554:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301675776 00000100:00100000:3.0:1788813129.088614:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 363 00000100:00100000:3.0:1788813129.088623:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2399:x1875706301675776:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813129.088682:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2399:x1875706301675776:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 60us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813129.088689:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 363 00000100:00100000:0.0:1788813129.089195:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301675904 00000100:00100000:0.0:1788813129.089211:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301675904 00000100:00100000:0.0:1788813129.089271:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301676160 00000100:00100000:0.0:1788813129.089274:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301676160 00000100:00100000:0.0:1788813129.089288:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301676032 00000100:00100000:0.0:1788813129.089290:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301676032 00000100:00100000:0.0:1788813129.089301:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301676288 00000100:00100000:0.0:1788813129.089302:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301676288 00000100:00100000:0.0:1788813129.089315:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 223 00000100:00100000:0.0:1788813129.089321:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301675904:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813129.089359:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301675904:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 39us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813129.089366:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 223 00000100:00100000:0.0:1788813129.089379:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 224 00000100:00100000:0.0:1788813129.089384:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301676160:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813129.089402:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301676160:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 18us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813129.089407:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 224 00000100:00100000:0.0:1788813129.089416:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 225 00000100:00100000:0.0:1788813129.089421:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301676032:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813129.089438:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301676032:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 17us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813129.089443:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 225 00000100:00100000:0.0:1788813129.089451:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 226 00000100:00100000:0.0:1788813129.089456:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301676288:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813129.089473:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301676288:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 17us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813129.089484:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 226 00000100:00080000:3.0:1788813129.089990:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813129.089995:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788813129.637495:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788813129.700402:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788813129.708483:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788813130.085281:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313288832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813130.085351:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813130.085455:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313288832 00000100:00100000:3.0:1788813130.085464:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313288832 00000100:00100000:3.0:1788813130.085516:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788813130.085526:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313288832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788813130.085558:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788813130.085620:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313288832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813130.085636:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788813130.085681:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313288832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813130.088763:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943643100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313289088:0@lo:400:kworker.0 00000100:00100000:3.0:1788813130.088823:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813130.088873:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313289600:0@lo:400:kworker.0 00000100:00100000:3.0:1788813130.088898:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813130.088922:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313290112:0@lo:400:kworker.0 00000100:00100000:3.0:1788813130.088960:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813130.088989:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788813130.088996:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313288960:0@lo:400:kworker.0 00000100:00100000:3.0:1788813130.089023:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813130.089045:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313289472:0@lo:400:kworker.0 00000100:00100000:3.0:1788813130.089065:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813130.089082:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313289984:0@lo:400:kworker.0 00000100:00100000:3.0:1788813130.089320:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813130.089345:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313290496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813130.089370:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813130.089401:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313289088 00000100:00100000:3.0:1788813130.089407:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313289088 00000100:00100000:3.0:1788813130.089445:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313289600 00000100:00100000:3.0:1788813130.089448:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313289600 00000100:00100000:3.0:1788813130.089472:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313290112 00000100:00100000:3.0:1788813130.089474:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313290112 00000100:00100000:3.0:1788813130.089487:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313289472 00000100:00100000:3.0:1788813130.089489:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313289472 00000100:00100000:3.0:1788813130.089517:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313289984 00000100:00100000:3.0:1788813130.089520:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313289984 00000100:00100000:3.0:1788813130.089534:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788813130.089542:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313289088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813130.089590:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313289088:12345-0@lo:400:kworker.0 Request processed in 49us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813130.089598:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788813130.089698:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788813130.089709:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313289600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813130.089744:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313289600:12345-0@lo:400:kworker.0 Request processed in 39us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813130.089750:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788813130.089768:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788813130.089774:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313290112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813130.089801:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313290112:12345-0@lo:400:kworker.0 Request processed in 27us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813130.089806:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788813130.089817:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788813130.089823:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313289472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813130.089848:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313289472:12345-0@lo:400:kworker.0 Request processed in 25us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813130.089854:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788813130.089866:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788813130.089871:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313289984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813130.089897:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313289984:12345-0@lo:400:kworker.0 Request processed in 26us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813130.089902:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788813130.090039:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313289216:0@lo:400:kworker.0 00000100:00100000:1.0:1788813130.090071:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813130.090090:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313289728:0@lo:400:kworker.0 00000100:00100000:1.0:1788813130.090191:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813130.090212:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313290240:0@lo:400:kworker.0 00000100:00100000:1.0:1788813130.090233:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813130.090264:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788813130.090271:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313289344:0@lo:400:kworker.0 00000100:00100000:1.0:1788813130.090295:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813130.090314:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313289856:0@lo:400:kworker.0 00000100:00100000:1.0:1788813130.090334:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813130.090352:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313290368:0@lo:400:kworker.0 00000100:00100000:1.0:1788813130.090374:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813130.090427:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313289728 00000100:00100000:1.0:1788813130.090431:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313289728 00000100:00100000:1.0:1788813130.090455:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313290240 00000100:00100000:1.0:1788813130.090457:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313290240 00000100:00100000:1.0:1788813130.090468:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313289856 00000100:00100000:1.0:1788813130.090477:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313289856 00000100:00100000:1.0:1788813130.090493:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313290368 00000100:00100000:1.0:1788813130.090495:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313290368 00000100:00100000:1.0:1788813130.090508:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788813130.090514:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a766b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313289728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813130.090549:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a766b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313289728:12345-0@lo:400:kworker.0 Request processed in 35us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813130.090555:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788813130.091314:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313289216 00000100:00100000:3.0:1788813130.091320:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313289216 00000100:00100000:3.0:1788813130.091338:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788813130.091344:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313289216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813130.091378:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313289216:12345-0@lo:400:kworker.0 Request processed in 34us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813130.091384:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788813130.091410:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313288960 00000100:00100000:3.0:1788813130.091414:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313288960 00000100:00100000:3.0:1788813130.091445:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788813130.091452:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313288960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813130.091484:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313288960:12345-0@lo:400:kworker.0 Request processed in 33us (2460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813130.091490:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788813130.091519:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313290496 00000100:00100000:3.0:1788813130.091523:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313290496 00000100:00100000:3.0:1788813130.091547:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788813130.091553:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1875706313290496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788813130.091571:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813130.091852:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788813130.091859:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3627:x1875706313290240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813130.091890:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3627:x1875706313290240:12345-0@lo:400:kworker.0 Request processed in 32us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813130.091895:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788813130.091907:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788813130.091914:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313289856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813130.091960:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313289856:12345-0@lo:400:kworker.0 Request processed in 47us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813130.091965:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788813130.091976:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788813130.091983:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313290368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813130.092008:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313290368:12345-0@lo:400:kworker.0 Request processed in 27us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813130.092014:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788813130.092034:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313289344 00000100:00100000:1.0:1788813130.092038:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313289344 00000100:00100000:1.0:1788813130.092063:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788813130.092069:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313289344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813130.092694:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313290496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813130.092707:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788813130.092728:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813130.092734:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813130.092737:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813130.092739:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788813130.092755:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313290624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813130.092788:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813130.092825:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313288960:0@lo:400:kworker.0 00000100:00100000:3.0:1788813130.092841:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313289472:0@lo:400:kworker.0 00000100:00100000:3.0:1788813130.092851:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313289984:0@lo:400:kworker.0 00000100:00100000:3.0:1788813130.092868:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313290496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813130.092880:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943643100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313289088:0@lo:400:kworker.0 00010000:00080000:3.0:1788813130.092893:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943642680 x1875706313289600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813130.092903:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313289600:0@lo:400:kworker.0 00010000:00080000:3.0:1788813130.092914:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76417480 x1875706313290112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813130.092923:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313290112:0@lo:400:kworker.0 00000100:00100000:3.0:1788813130.092983:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313290624 00000100:00100000:3.0:1788813130.092987:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313290624 00000100:00100000:3.0:1788813130.093011:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788813130.093017:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313290624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813130.093040:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813130.093074:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313290624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813130.093080:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788813130.093209:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313289344:12345-0@lo:400:kworker.0 Request processed in 1139us (2912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813130.093217:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788813130.093261:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313289344:0@lo:400:kworker.0 00010000:00080000:1.0:1788813130.093274:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943641880 x1875706313289856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813130.093282:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313289856:0@lo:400:kworker.0 00000100:00100000:1.0:1788813130.093292:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313290368:0@lo:400:kworker.0 00000100:00100000:1.0:1788813130.093301:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313289216:0@lo:400:kworker.0 00010000:00080000:1.0:1788813130.093311:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943640e00 x1875706313289728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813130.093318:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313289728:0@lo:400:kworker.0 00000100:00100000:1.0:1788813130.093326:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313290240:0@lo:400:kworker.0 00000100:00100000:3.0:1788813130.093701:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313290624:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788813130.725269:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813131.751195:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813132.132092:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313290752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813132.132165:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813132.132451:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313290752 00000100:00100000:1.0:1788813132.132460:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313290752 00000100:00100000:1.0:1788813132.132521:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788813132.132532:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313290752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788813132.132559:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813132.132602:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313290752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813132.132609:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1788813132.132740:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813132.132783:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943755180 x1875706313290752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813132.132801:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313290752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813132.158979:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313290880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813132.159051:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813132.159124:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313290880 00000100:00100000:0.0:1788813132.159143:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313290880 00000100:00080000:3.0:1788813132.159183:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813132.159212:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788813132.159221:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313290880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813132.159258:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813132.159305:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313290880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813132.159313:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1788813132.159346:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a46542a00 x1875706313290880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813132.159364:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313290880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813132.652654:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813132.652676:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313291008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813132.653208:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813132.655639:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313291008 00000100:00100000:2.0:1788813132.655652:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313291008 00000100:00100000:2.0:1788813132.656084:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788813132.656096:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313291008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813132.656132:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788813132.656212:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313291008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (3004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813132.656219:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788813132.656284:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313291008:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788813132.775120:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813133.804487:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813134.212017:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813134.212043:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813134.212065:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813134.212080:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813134.212109:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813134.212134:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301676544 00000100:00100000:3.0:1788813134.212142:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301676544 00000100:00100000:3.0:1788813134.212194:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301676800 00000100:00100000:3.0:1788813134.212196:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301676800 00000100:00100000:3.0:1788813134.212206:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301676672 00000100:00100000:3.0:1788813134.212208:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301676672 00000100:00100000:3.0:1788813134.212243:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301676928 00000100:00100000:3.0:1788813134.212245:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301676928 00000100:00100000:3.0:1788813134.212259:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 233 00000100:00100000:3.0:1788813134.212267:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301676544:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813134.212330:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301676544:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 64us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813134.212337:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 233 00000100:00100000:3.0:1788813134.212351:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 234 00000100:00100000:3.0:1788813134.212357:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301676800:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813134.212476:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301676800:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 117us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813134.212483:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 234 00000100:00100000:3.0:1788813134.212496:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 235 00000100:00100000:3.0:1788813134.212502:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301676672:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813134.212526:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301676672:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813134.212533:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 235 00000100:00100000:3.0:1788813134.212545:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 236 00000100:00100000:3.0:1788813134.212552:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301676928:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813134.212574:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301676928:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 23us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813134.212580:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 236 00000100:00100000:3.0:1788813134.212601:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301676416 00000100:00100000:3.0:1788813134.212604:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301676416 00000100:00100000:3.0:1788813134.212635:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 365 00000100:00100000:3.0:1788813134.212640:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301676416:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813134.212662:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301676416:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 22us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813134.212667:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 365 00000100:00080000:3.0:1788813134.212971:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813134.212976:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788813134.821781:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813135.207608:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813135.207639:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313291136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813135.207749:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813135.207825:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313291264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813135.207856:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813135.207903:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313291136 00000100:00100000:1.0:1788813135.207927:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313291136 00000100:00100000:1.0:1788813135.208012:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788813135.208023:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313291136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788813135.208070:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788813135.208192:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313291136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 170us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813135.208212:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788813135.208241:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313291264 00000100:00100000:1.0:1788813135.208246:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313291264 00000100:00100000:1.0:1788813135.208285:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788813135.208293:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313291264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788813135.208317:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813135.208351:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313291264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813135.208358:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1788813135.208379:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813135.208424:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313291264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813135.208458:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313291136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813135.209248:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313291392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813135.209292:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813135.209387:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313291392 00000100:00100000:3.0:1788813135.209393:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313291392 00000100:00100000:3.0:1788813135.209455:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788813135.209463:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313291392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813135.209677:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813135.209725:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313291392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 263us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813135.209733:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788813135.209797:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313291392:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788813135.211586:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813135.212388:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313291904:0@lo:400:kworker.0 00000100:00100000:0.0:1788813135.212603:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313291648:0@lo:400:kworker.0 00000100:00100000:0.0:1788813135.212669:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813135.212719:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64340e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313292160:0@lo:400:kworker.0 00000100:00100000:0.0:1788813135.212743:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813135.212768:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313292672:0@lo:400:kworker.0 00000100:00100000:0.0:1788813135.212791:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813135.212819:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788813135.212825:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313291520:0@lo:400:kworker.0 00000100:00100000:0.0:1788813135.212878:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813135.212917:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313292032:0@lo:400:kworker.0 00000100:00100000:0.0:1788813135.212962:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813135.212980:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313292544:0@lo:400:kworker.0 00000100:00100000:0.0:1788813135.213002:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813135.213153:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813135.213190:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64342680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313292416:0@lo:400:kworker.0 00000100:00100000:3.0:1788813135.213228:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813135.213246:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788813135.213251:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313291776:0@lo:400:kworker.0 00000100:00100000:3.0:1788813135.213269:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813135.213278:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64342300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313292288:0@lo:400:kworker.0 00000100:00100000:3.0:1788813135.213298:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813135.213329:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313291648 00000100:00100000:3.0:1788813135.213338:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313291648 00000100:00100000:3.0:1788813135.213393:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313292160 00000100:00100000:3.0:1788813135.213397:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313292160 00000100:00100000:0.0:1788813135.214885:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313291904 00000100:00100000:0.0:1788813135.214911:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313291904 00000100:00100000:0.0:1788813135.214981:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788813135.214992:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313291904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813135.215348:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313292416 00000100:00100000:1.0:1788813135.215354:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313292416 00000100:00100000:1.0:1788813135.215390:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313292288 00000100:00100000:1.0:1788813135.215394:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313292288 00000100:00100000:1.0:1788813135.215417:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788813135.215436:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313292416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813135.215548:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313291520 00000100:00100000:2.0:1788813135.215553:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313291520 00000100:00100000:2.0:1788813135.215583:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788813135.215590:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313291520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813135.225843:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313292672 00000100:00100000:3.0:1788813135.225874:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313292672 00000100:00100000:3.0:1788813135.225982:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313292032 00000100:00100000:3.0:1788813135.225987:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313292032 00000100:00100000:3.0:1788813135.226005:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313292544 00000100:00100000:3.0:1788813135.226007:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313292544 00000100:00100000:3.0:1788813135.226020:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313291776 00000100:00100000:3.0:1788813135.226023:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313291776 00000100:00100000:3.0:1788813135.226043:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788813135.226055:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313291648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813135.226334:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313291648:12345-0@lo:400:kworker.0 Request processed in 281us (13664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813135.226343:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788813135.226368:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788813135.226375:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313292160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813135.226410:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313292160:12345-0@lo:400:kworker.0 Request processed in 36us (13666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813135.226416:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788813135.226429:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788813135.226434:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313292672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813135.226467:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313292672:12345-0@lo:400:kworker.0 Request processed in 33us (13676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813135.226473:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788813135.226547:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788813135.226554:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313292032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813135.226585:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313292032:12345-0@lo:400:kworker.0 Request processed in 31us (13622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813135.226608:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788813135.226620:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788813135.226625:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313292544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813135.226653:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313292544:12345-0@lo:400:kworker.0 Request processed in 29us (13651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813135.226659:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788813135.226670:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788813135.226675:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313291776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813135.226700:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313291776:12345-0@lo:400:kworker.0 Request processed in 26us (13430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813135.226706:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788813135.226795:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313292032:0@lo:400:kworker.0 00000100:00100000:3.0:1788813135.226810:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313292544:0@lo:400:kworker.0 00000100:00100000:3.0:1788813135.226823:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313291648:0@lo:400:kworker.0 00010000:00080000:3.0:1788813135.226837:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a64340e00 x1875706313292160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813135.226848:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64340e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313292160:0@lo:400:kworker.0 00010000:00080000:3.0:1788813135.226858:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a71410a80 x1875706313292672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813135.226867:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313292672:0@lo:400:kworker.0 00000100:00100000:1.0:1788813135.227133:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313292416:12345-0@lo:400:kworker.0 Request processed in 8435us (10640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813135.227145:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788813135.227287:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788813135.227298:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313292288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813135.227342:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313292288:12345-0@lo:400:kworker.0 Request processed in 48us (14043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813135.227348:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788813135.227383:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813135.227389:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813135.227392:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788813135.229077:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313291776:0@lo:400:kworker.0 00000100:00100000:0.0:1788813135.229220:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313291904:12345-0@lo:400:kworker.0 Request processed in 14227us (16064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813135.229233:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:3.0:1788813135.229378:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a64342300 x1875706313292288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813135.229410:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64342300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313292288:0@lo:400:kworker.0 00000100:00100000:3.0:1788813135.229427:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313291904:0@lo:400:kworker.0 00010000:00080000:3.0:1788813135.229439:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a64342680 x1875706313292416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813135.229446:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64342680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313292416:0@lo:400:kworker.0 00000100:00100000:2.0:1788813135.235849:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313291520:12345-0@lo:400:kworker.0 Request processed in 20245us (22955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813135.235879:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788813135.246750:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313291520:0@lo:400:kworker.0 00010000:00010000:2.0:1788813135.845573:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788813135.975083:0:14027:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:32:15 (1788813135) 00010000:00010000:3.0:1788813136.868343:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813137.253558:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313292800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813137.253832:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813137.253897:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313292800 00000100:00100000:1.0:1788813137.253910:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313292800 00000100:00100000:1.0:1788813137.254024:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788813137.254038:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313292800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788813137.254078:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813137.254151:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313292800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813137.254156:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788813137.254234:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313292928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813137.254274:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788813137.254346:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943489180 x1875706313292800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813137.254360:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313292928 00000100:00100000:2.0:1788813137.254372:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313292800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813137.254380:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313292928 00000100:00100000:1.0:1788813137.254416:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788813137.254421:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313292928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813137.254429:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813137.254460:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313292928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813137.254465:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1788813137.254586:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788813137.254690:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a46540380 x1875706313292928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813137.254707:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313292928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813137.764607:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813137.764640:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313293056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813137.764737:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813137.765156:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313293056 00000100:00100000:2.0:1788813137.765168:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313293056 00000100:00100000:2.0:1788813137.765249:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788813137.765261:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313293056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813137.765309:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788813137.765378:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313293056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813137.765386:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788813137.770366:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313293056:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788813137.892553:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813138.410664:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813138.411092:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301677056 00000100:00100000:0.0:1788813138.411108:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301677056 00000100:00100000:0.0:1788813138.411239:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 40 00000100:00100000:0.0:1788813138.411262:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:11056:x1875706301677056:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813138.411295:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788813138.412464:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788813138.414593:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff702cf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07296ab expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.414697:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702cfe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.414726:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702cfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.414741:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702cfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813138.414794:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788813138.414798:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813138.414840:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702cfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.414870:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff702cf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296ab expref: 7 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.414892:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702cfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296ab expref: 6 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.414901:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a74b15700) 00010000:00010000:0.0:1788813138.414903:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813138.414907:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e5a00, rc 0) 00000100:00100000:0.0:1788813138.415118:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:11056:x1875706301677056:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 3866us (4468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813138.415128:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 40 00000100:00100000:3.0:1788813138.435406:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813138.435613:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301677184 00000100:00100000:0.0:1788813138.435626:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301677184 00000100:00100000:0.0:1788813138.435699:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 41 00000100:00100000:0.0:1788813138.435711:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:11058:x1875706301677184:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813138.435738:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813138.435783:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff702d05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07296b2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.435867:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.435882:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.435896:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.435912:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702d13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.435919:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702d13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.435925:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702d13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436028:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff702d1a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436035:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff702d1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436041:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff702d1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813138.436087:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788813138.436090:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813138.436113:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff702d1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436195:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436204:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436211:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436218:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdac00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813138.436223:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436233:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436247:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a74b15700) 00010000:00010000:0.0:1788813138.436250:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813138.436308:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436315:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436333:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702d13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436341:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702d13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436346:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702d13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436358:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdaa00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813138.436361:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702d13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436368:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702d13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436376:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff948a74b15100) 00010000:00010000:0.0:1788813138.436379:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813138.436381:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702d13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436387:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702d13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436423:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff702d05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296b2 expref: 8 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436438:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff702d1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296b2 expref: 7 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813138.436445:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff948a74b15d00) 00010000:00010000:0.0:1788813138.436448:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813138.436450:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdbe00, rc 0) 00000100:00100000:0.0:1788813138.436641:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:11058:x1875706301677184:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 931us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813138.436648:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 41 00000100:00100000:3.0:1788813138.451893:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813138.452056:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301677312 00000100:00100000:0.0:1788813138.452092:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301677312 00000100:00100000:0.0:1788813138.452197:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:0.0:1788813138.452214:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:11058:x1875706301677312:12345-192.168.202.13@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788813138.452338:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:11058:x1875706301677312:12345-192.168.202.13@tcp:900:lhsmtool_posix.0 Request processed in 130us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813138.452347:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:1.0:1788813138.460418:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813138.460555:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301677568 00000100:00100000:3.0:1788813138.460568:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301677568 00000100:00100000:3.0:1788813138.460636:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 42 00000100:00100000:3.0:1788813138.460648:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:11058:x1875706301677568:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813138.460675:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813138.460703:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702d21 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07296b9 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813138.460798:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702d28 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813138.460817:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702d28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813138.460851:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702d28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813138.462362:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702d2f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813138.462385:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702d2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813138.462399:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702d2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.462645:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08400/0xf32533d6ff702d36 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.462664:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08400/0xf32533d6ff702d36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.462675:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08400/0xf32533d6ff702d36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813138.462691:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788813138.462839:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702d28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.462849:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702d28 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.462866:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702d28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.462889:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813138.462903:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702d28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.462913:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702d28 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.462963:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff948a74b15d00) 00010000:00010000:2.0:1788813138.462967:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813138.462974:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702d28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.462982:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702d28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.463000:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702d2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.463007:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702d2f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.463013:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702d2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.463019:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813138.463022:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702d2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.463029:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702d2f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.463051:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff948a7b725100) 00010000:00010000:2.0:1788813138.463053:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813138.463057:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702d2f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.463065:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702d2f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.463520:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702d21 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296b9 expref: 10 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.463538:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08400/0xf32533d6ff702d36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296b9 expref: 9 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813138.463546:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6fe40300) 00010000:00010000:2.0:1788813138.463548:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813138.463551:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08400, rc 0) 00000100:00100000:2.0:1788813138.463649:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:11058:x1875706301677568:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 3001us (3243us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788813138.463659:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 42 00000100:00100000:3.0:1788813138.469365:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813138.469537:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301677696 00000100:00100000:0.0:1788813138.469550:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301677696 00000100:00100000:0.0:1788813138.469625:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 43 00000100:00100000:0.0:1788813138.469639:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:11058:x1875706301677696:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788813138.469789:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:11058:x1875706301677696:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 Request processed in 152us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813138.469798:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 43 00000100:00100000:2.0:1788813138.471496:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813138.471598:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301677824 00000100:00100000:0.0:1788813138.471607:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301677824 00000100:00100000:0.0:1788813138.471683:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 44 00000100:00100000:0.0:1788813138.471693:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:11058:x1875706301677824:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1788813138.472095:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788813138.478704:0:6495:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6962us 00000100:00100000:0.0:1788813138.494846:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:11058:x1875706301677824:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 Request processed in 23144us (23350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813138.494861:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 44 00000040:00080000:3.0:1788813138.918974:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788813138.919984:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788813138.922142:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813139.328978:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813139.329025:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813139.329063:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301678080 00000100:00100000:3.0:1788813139.329075:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301678080 00000100:00100000:3.0:1788813139.329151:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 243 00000100:00100000:3.0:1788813139.329173:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2398:x1875706301678080:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813139.329262:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2398:x1875706301678080:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 101us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813139.329281:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 243 00000100:00100000:0.0:1788813139.330452:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301677952 00000100:00100000:0.0:1788813139.330461:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301677952 00000100:00100000:0.0:1788813139.330509:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 367 00000100:00100000:0.0:1788813139.330518:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301677952:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813139.330602:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301677952:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 85us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813139.330610:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 367 00000100:00100000:0.0:1788813139.332616:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813139.332666:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813139.332711:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813139.332740:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301678336 00000100:00100000:0.0:1788813139.332751:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301678336 00000100:00100000:0.0:1788813139.332821:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301678208 00000100:00100000:0.0:1788813139.332825:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301678208 00000100:00100000:0.0:1788813139.332840:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301678464 00000100:00100000:0.0:1788813139.332842:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301678464 00000100:00100000:0.0:1788813139.332861:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 244 00000100:00100000:0.0:1788813139.332870:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301678336:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813139.332982:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301678336:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 112us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813139.332990:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 244 00000100:00100000:0.0:1788813139.333008:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 245 00000100:00100000:0.0:1788813139.333014:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301678208:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813139.333036:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301678208:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 23us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813139.333042:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 245 00000100:00100000:0.0:1788813139.333052:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 246 00000100:00100000:0.0:1788813139.333057:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301678464:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813139.333075:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301678464:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 18us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813139.333095:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 246 00000100:00080000:0.0:1788813139.333116:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788813139.333121:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788813139.940751:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788813139.941773:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788813139.942402:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813140.324217:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894348b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313293184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813140.324317:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813140.324421:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313293184 00000100:00100000:1.0:1788813140.324430:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313293184 00000100:00100000:1.0:1788813140.324501:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788813140.324514:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313293184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788813140.324559:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813140.325128:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313293184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 616us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813140.325137:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1788813140.325178:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813140.325287:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894348b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313293184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813140.326143:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313293440:0@lo:400:kworker.0 00000100:00100000:2.0:1788813140.326221:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813140.326286:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313293440 00000100:00100000:2.0:1788813140.326293:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313293440 00000100:00100000:2.0:1788813140.326351:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788813140.326380:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313293440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813140.326433:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313293440:12345-0@lo:400:kworker.0 Request processed in 54us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813140.326440:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788813140.326488:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313293440:0@lo:400:kworker.0 00000100:00100000:2.0:1788813140.326526:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313293568:0@lo:400:kworker.0 00000100:00100000:2.0:1788813140.326555:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813140.326643:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313293952:0@lo:400:kworker.0 00000100:00100000:2.0:1788813140.326673:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813140.326721:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894365a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313294080:0@lo:400:kworker.0 00000100:00100000:2.0:1788813140.326743:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813140.326796:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313294464:0@lo:400:kworker.0 00000100:00100000:2.0:1788813140.327720:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813140.327806:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313294592:0@lo:400:kworker.0 00000100:00100000:2.0:1788813140.328030:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813140.328247:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813140.328272:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313293312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813140.328306:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813140.328339:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313293952 00000100:00100000:3.0:1788813140.328345:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313293952 00000100:00100000:3.0:1788813140.328386:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313293312 00000100:00100000:3.0:1788813140.328388:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313293312 00000100:00100000:3.0:1788813140.328405:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788813140.328412:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313293952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813140.328459:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313293952:12345-0@lo:400:kworker.0 Request processed in 48us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813140.328465:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788813140.328480:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788813140.328485:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313293312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788813140.328512:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788813140.328545:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313293312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813140.328551:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788813140.328590:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313293312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813140.328620:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313293952:0@lo:400:kworker.0 00000100:00100000:0.0:1788813140.328842:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313293568 00000100:00100000:0.0:1788813140.328847:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313293568 00000100:00100000:0.0:1788813140.328897:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313294080 00000100:00100000:0.0:1788813140.328900:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313294080 00000100:00100000:0.0:1788813140.328927:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313294592 00000100:00100000:0.0:1788813140.328945:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313294592 00000100:00100000:0.0:1788813140.328964:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788813140.328971:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313293568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813140.329016:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313293568:12345-0@lo:400:kworker.0 Request processed in 45us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813140.329022:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788813140.329037:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788813140.329043:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313294080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813140.329071:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313294080:12345-0@lo:400:kworker.0 Request processed in 29us (2327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813140.329077:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788813140.329088:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788813140.329094:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313294592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813140.329133:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313294592:12345-0@lo:400:kworker.0 Request processed in 39us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813140.329139:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788813140.332735:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313294464 00000100:00100000:1.0:1788813140.332755:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313294464 00000100:00100000:1.0:1788813140.332841:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788813140.332865:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313294464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813140.333016:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313294464:12345-0@lo:400:kworker.0 Request processed in 165us (5297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813140.333038:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788813140.333079:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313293696:0@lo:400:kworker.0 00000100:00100000:1.0:1788813140.333137:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813140.333181:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313294208:0@lo:400:kworker.0 00000100:00100000:1.0:1788813140.333953:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813140.333981:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313294720:0@lo:400:kworker.0 00000100:00100000:1.0:1788813140.334006:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813140.334034:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788813140.334041:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313293824:0@lo:400:kworker.0 00000100:00100000:1.0:1788813140.334063:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813140.334083:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313294336:0@lo:400:kworker.0 00000100:00100000:1.0:1788813140.334107:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813140.334266:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313294848:0@lo:400:kworker.0 00000100:00100000:1.0:1788813140.334291:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813140.334331:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313293696 00000100:00100000:1.0:1788813140.334338:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313293696 00000100:00100000:1.0:1788813140.334374:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788813140.334383:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313293696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813140.334437:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313293696:12345-0@lo:400:kworker.0 Request processed in 54us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813140.334444:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788813140.334468:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313294208 00000100:00100000:1.0:1788813140.334472:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313294208 00000100:00100000:1.0:1788813140.334495:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313294720 00000100:00100000:1.0:1788813140.334498:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313294720 00000100:00100000:1.0:1788813140.334528:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313293824 00000100:00100000:1.0:1788813140.334531:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313293824 00000100:00100000:1.0:1788813140.334544:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788813140.334549:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313294208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813140.334583:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313294208:12345-0@lo:400:kworker.0 Request processed in 34us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813140.334589:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788813140.334600:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788813140.334606:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313294720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813140.334631:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313294720:12345-0@lo:400:kworker.0 Request processed in 26us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813140.334637:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788813140.334648:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788813140.334654:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313293824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813140.334680:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313293824:12345-0@lo:400:kworker.0 Request processed in 27us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813140.334686:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788813140.334713:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313294336 00000100:00100000:1.0:1788813140.334717:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313294336 00000100:00100000:1.0:1788813140.334740:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313294848 00000100:00100000:1.0:1788813140.334743:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313294848 00000100:00100000:1.0:1788813140.334763:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788813140.334770:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313294336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813140.334797:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313294336:12345-0@lo:400:kworker.0 Request processed in 29us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813140.334803:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788813140.334812:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788813140.334838:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313294848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813140.335419:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313294592:0@lo:400:kworker.0 00000100:00100000:3.0:1788813140.335436:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894365a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313294080:0@lo:400:kworker.0 00000100:00100000:3.0:1788813140.335450:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313293568:0@lo:400:kworker.0 00000100:00100000:1.0:1788813140.336086:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313294848:12345-0@lo:400:kworker.0 Request processed in 1247us (1791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813140.336096:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1788813140.339732:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813140.339747:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813140.339751:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813140.339767:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813140.339797:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313294976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813140.339916:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788813140.340064:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894365a300 x1875706313294464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813140.340082:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313294464:0@lo:400:kworker.0 00000100:00100000:3.0:1788813140.340138:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313293824:0@lo:400:kworker.0 00010000:00080000:3.0:1788813140.340163:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894365b800 x1875706313294336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813140.340174:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313294336:0@lo:400:kworker.0 00000100:00100000:3.0:1788813140.340187:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313294848:0@lo:400:kworker.0 00000100:00100000:3.0:1788813140.340210:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313293696:0@lo:400:kworker.0 00010000:00080000:3.0:1788813140.340225:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943659880 x1875706313294208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813140.340235:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313294208:0@lo:400:kworker.0 00010000:00080000:3.0:1788813140.340247:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894365ad80 x1875706313294720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813140.340255:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313294720:0@lo:400:kworker.0 00000100:00100000:2.0:1788813140.341210:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313294976 00000100:00100000:2.0:1788813140.341221:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313294976 00000100:00100000:2.0:1788813140.341287:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788813140.341299:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313294976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813140.341332:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813140.341407:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313294976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813140.341415:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788813140.341468:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313294976:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788813140.965204:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813141.583299:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813141.583744:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301678592 00000100:00100000:0.0:1788813141.583765:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301678592 00000100:00100000:0.0:1788813141.583876:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 45 00000100:00100000:0.0:1788813141.583886:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:11100:x1875706301678592:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813141.583905:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813141.583924:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07296c0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584037:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584051:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584062:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584082:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702d52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584096:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702d52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584102:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702d52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584154:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584161:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584166:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584177:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdbc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813141.584181:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584188:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584199:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a74b15700) 00010000:00010000:0.0:1788813141.584201:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813141.584205:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584211:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584220:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702d52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584225:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702d52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584230:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702d52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584233:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813141.584235:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702d52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584240:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702d52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584252:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff948a6aed9e00) 00010000:00010000:0.0:1788813141.584254:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813141.584256:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702d52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584261:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702d52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584290:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d44 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296c0 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584298:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a74b15700) 00010000:00010000:0.0:1788813141.584300:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813141.584303:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296c0 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813141.584310:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdac00, rc 0) 00000100:00100000:0.0:1788813141.584364:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:11100:x1875706301678592:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 481us (1076us total) trans 0 rc 301/301 00000100:00100000:0.0:1788813141.584370:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 45 00000100:00080000:3.0:1788813141.584743:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813141.592240:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813141.592394:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301678848 00000100:00100000:1.0:1788813141.592403:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301678848 00000100:00100000:1.0:1788813141.592497:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00100000:1.0:1788813141.592507:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:11100:x1875706301678848:12345-192.168.202.13@tcp:36:lfs.0 00010000:00010000:1.0:1788813141.592556:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813141.592580:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702cfe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296ab expref: 9 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.592596:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a74b15700) 00010000:00010000:1.0:1788813141.592608:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813141.592661:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702d59 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.592675:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702d59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.592685:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702d59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.592698:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702d60 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.592705:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702d60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.592729:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702d60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.593254:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702d67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.593264:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702d67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.593272:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702d67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813141.593287:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017588d4c reply state 00000000569f34ae transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702d67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.593297:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702d67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.593304:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:1.0:1788813141.593307:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788813141.593309:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788813141.593313:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788813141.593320:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702d59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.593327:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702d59 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.593334:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702d59 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.593340:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813141.593350:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702d59 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.593359:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702d59 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.593368:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a455eef00) 00010000:00010000:1.0:1788813141.593370:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813141.593374:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702d59 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.593381:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702d59 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813141.593394:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017588d4c reply state 00000000569f34ae transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702d60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.593401:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702d60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813141.593407:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff948a455ee200) 00010000:00010000:1.0:1788813141.593409:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788813141.593411:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788813141.593501:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+10:11100:x1875706301678848:12345-192.168.202.13@tcp:36:lfs.0 Request processed in 994us (1270us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788813141.593509:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00100000:2.0:1788813141.861468:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813141.861902:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301678976 00000100:00100000:3.0:1788813141.861917:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301678976 00000100:00100000:3.0:1788813141.862050:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 47 00000100:00100000:3.0:1788813141.862063:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+10:11108:x1875706301678976:12345-192.168.202.13@tcp:101:lctl.0 00010000:00010000:3.0:1788813141.862121:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813141.862159:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702d6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07296c7 expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813141.862247:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff702d75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813141.862262:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff702d75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813141.862275:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff702d75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813141.862333:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788813141.862337:0:9156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813141.862738:0:9156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff702d75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813141.862768:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702d6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296c7 expref: 12 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813141.862792:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff702d75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296c7 expref: 11 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813141.862802:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764bee00) 00010000:00010000:3.0:1788813141.862805:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813141.862809:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656a00, rc 0) 00000100:00100000:3.0:1788813141.863799:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+11:11108:x1875706301678976:12345-192.168.202.13@tcp:101:lctl.0 Request processed in 1733us (2342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813141.863808:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 47 00010000:00010000:3.0:1788813141.988754:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813142.040698:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813142.040968:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301679104 00000100:00100000:0.0:1788813142.040983:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301679104 00000100:00100000:0.0:1788813142.041070:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 48 00000100:00100000:0.0:1788813142.041083:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+11:11114:x1875706301679104:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813142.041121:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813142.041159:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702d7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07296ce expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041274:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041293:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041305:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041318:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702d8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041326:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702d8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041333:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702d8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041440:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041449:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041457:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813142.041502:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788813142.041506:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813142.041571:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041597:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041604:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041610:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041616:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdbc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813142.041622:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041630:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041644:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764bee00) 00010000:00010000:0.0:1788813142.041647:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813142.041653:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041671:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702d83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041687:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702d8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041694:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702d8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041700:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702d8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041711:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813142.041714:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702d8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041721:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702d8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041729:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff948a455ee200) 00010000:00010000:0.0:1788813142.041731:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813142.041734:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702d8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041740:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702d8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041771:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702d7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296ce expref: 13 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041787:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296ce expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.041795:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:0.0:1788813142.041798:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788813142.041800:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdac00, rc 0) 00000100:00100000:1.0:1788813142.043069:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+12:11114:x1875706301679104:12345-192.168.202.13@tcp:101:bash.0 Request processed in 1981us (2378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813142.043082:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 48 00000100:00100000:0.0:1788813142.050761:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813142.050912:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301679360 00000100:00100000:1.0:1788813142.050982:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301679360 00000100:00100000:1.0:1788813142.051054:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 49 00000100:00100000:1.0:1788813142.051067:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+12:11114:x1875706301679360:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:1.0:1788813142.051094:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813142.051131:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702d98 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07296d5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.051289:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702d9f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.051308:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702d9f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.051322:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702d9f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.053860:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702da6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.053884:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702da6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.053899:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702da6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788813142.054489:0:6496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788813142.054624:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702dad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.054634:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702dad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.054658:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702dad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.054694:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702d9f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.054701:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702d9f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.054708:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702d9f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.054714:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813142.054718:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702d9f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.054725:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702d9f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.054736:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:1.0:1788813142.054739:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813142.054744:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702d9f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.054750:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702d9f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813142.054763:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c092297 reply state 00000000e934011f transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702da6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.054773:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702da6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.054786:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a455eef00) 00010000:00010000:1.0:1788813142.054788:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788813142.054792:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788813142.054831:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702d98 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296d5 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.054847:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702dad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296d5 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.054853:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a455ee400) 00010000:00010000:1.0:1788813142.054855:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813142.054858:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8a00, rc 0) 00000100:00100000:1.0:1788813142.055262:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:11114:x1875706301679360:12345-192.168.202.13@tcp:101:bash.0 Request processed in 3867us (4184us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788813142.055273:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 49 00000100:00100000:0.0:1788813142.062259:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813142.064870:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301679488 00000100:00100000:1.0:1788813142.064894:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301679488 00000100:00100000:1.0:1788813142.065040:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:1.0:1788813142.065051:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1875706301679488:12345-192.168.202.13@tcp:8:bash.0 00010000:00080000:1.0:1788813142.065095:0:8405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:1.0:1788813142.065158:0:8405:0:(genops.c:1384:class_connect()) connect: client d2fa4f95-78d4-4e44-8582-bb12ec2edfd4, cookie 0xf32533d6ff702dbb 00002000:00100000:1.0:1788813142.065175:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d2fa4f95-78d4-4e44-8582-bb12ec2edfd4/ffff948943728000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788813142.065201:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788813142.065320:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788813142.065366:0:8405:0:(import.c:65:import_set_state_nolock()) ffff948a44cc4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813142.065478:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2395:x1875706301679488:12345-192.168.202.13@tcp:8:bash.0 Request processed in 427us (3231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813142.065485:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:2.0:1788813142.092774:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813142.092971:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301679616 00000100:00100000:1.0:1788813142.092985:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301679616 00000100:00100000:1.0:1788813142.093084:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00100000:1.0:1788813142.093097:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:0:x1875706301679616:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:1.0:1788813142.093120:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813142.093159:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff702dc2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07296dc expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813142.093193:0:8404:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813142.093218:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=295s v=(0 0) 00010000:00010000:1.0:1788813142.093223:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813142.093233:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff702dc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296dc expref: 7 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.093257:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff702dc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296dc expref: 7 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.093282:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9400, rc 0) 00000100:00100000:1.0:1788813142.093351:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:0:x1875706301679616:12345-192.168.202.13@tcp:101:bash.0 Request processed in 257us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813142.093359:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00080000:3.0:1788813142.093858:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813142.097335:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813142.106587:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301679744 00000100:00100000:1.0:1788813142.106609:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301679744 00000100:00100000:0.0:1788813142.106922:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:0.0:1788813142.106972:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:11114:x1875706301679744:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813142.107000:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813142.107030:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07296e3 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.107072:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff702dc2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296dc expref: 8 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.107083:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813142.107087:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813142.107093:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.107135:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff702dc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296dc expref: 8 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.107162:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff702dc2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296dc expref: 8 pid: 8404 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813142.107179:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1875706313295104:192.168.202.13@tcp:104: 00000100:00100000:0.0:1788813142.107437:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45b7a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813142.123929:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813142.124711:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1875706313295104:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813142.124789:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.124816:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdbc00, rc 0) 00000100:00100000:1.0:1788813142.124897:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:11114:x1875706301679744:12345-192.168.202.13@tcp:101:bash.0 Request processed in 17928us (27574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813142.124907:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:2.0:1788813142.125384:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301679872 00000100:00100000:2.0:1788813142.125394:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301679872 00010000:00010000:2.0:1788813142.125451:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff702dc2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296dc expref: 8 pid: 8404 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813142.125490:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 52 00000100:00100000:2.0:1788813142.125502:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50685050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2396:x1875706301679872:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813142.125519:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813142.125548:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff702dc2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296dc expref: 8 pid: 8404 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.125866:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff702dc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296dc expref: 8 pid: 8404 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.125899:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075d48277/0xf32533d6ff702dc2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296dc expref: 8 pid: 8404 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.126036:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813142.126042:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813142.126052:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.126064:0:9502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.126127:0:9502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813142.126158:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894365ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9502:1875706313295232:192.168.202.13@tcp:105: 00000100:00100000:2.0:1788813142.126232:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788813142.142536:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894365ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9502:1875706313295232:192.168.202.13@tcp:105: 00010000:00010000:0.0:1788813142.142575:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813142.142665:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50685050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301679872:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 17157us (18754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813142.142700:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 52 00000100:00100000:0.0:1788813142.153907:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813142.155533:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301680128 00000100:00100000:1.0:1788813142.155557:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301680128 00000100:00100000:1.0:1788813142.155634:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00100000:1.0:1788813142.155647:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:11114:x1875706301680128:12345-192.168.202.13@tcp:35:bash.0 00000100:00100000:1.0:1788813142.157998:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:11114:x1875706301680128:12345-192.168.202.13@tcp:35:bash.0 Request processed in 2341us (4092us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788813142.158012:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00100000:2.0:1788813142.372484:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813142.372528:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313295360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813142.372631:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813142.373119:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313295360 00000100:00100000:1.0:1788813142.373131:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313295360 00000100:00100000:1.0:1788813142.373226:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788813142.373237:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313295360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788813142.373277:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813142.373329:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313295360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813142.373336:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788813142.373536:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813142.375245:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813142.375284:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313295488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813142.375368:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813142.375801:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313295360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813142.375880:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313295488 00000100:00100000:1.0:1788813142.375889:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313295488 00000100:00100000:1.0:1788813142.375977:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788813142.375987:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313295488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813142.376035:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813142.376088:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313295488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813142.376096:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1788813142.376750:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813142.377160:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313295488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813142.414351:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813142.414428:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301680384 00000100:00100000:3.0:1788813142.414438:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301680384 00000100:00100000:3.0:1788813142.414557:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 50 00000100:00100000:3.0:1788813142.414569:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:11124:x1875706301680384:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813142.414592:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813142.414613:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702dd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07296ea expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813142.414808:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788813142.414907:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702dd0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296ea expref: 18 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.414920:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764bee00) 00010000:00010000:3.0:1788813142.414924:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813142.414929:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702dd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296ea expref: 18 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.414984:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657e00, rc 0) 00000100:00100000:3.0:1788813142.415034:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+17:11124:x1875706301680384:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 467us (692us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788813142.415041:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 50 00000100:00100000:2.0:1788813142.422291:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813142.422400:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301680640 00000100:00100000:0.0:1788813142.422410:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301680640 00000100:00100000:0.0:1788813142.422514:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:0.0:1788813142.422525:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+17:11124:x1875706301680640:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:0.0:1788813142.422822:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:11124:x1875706301680640:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 299us (540us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788813142.422831:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:0.0:1788813142.502500:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813142.502589:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301680768 00000100:00100000:1.0:1788813142.502600:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301680768 00000100:00100000:1.0:1788813142.502797:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 51 00000100:00100000:1.0:1788813142.502811:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:11130:x1875706301680768:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813142.502834:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813142.502857:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702dde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07296f1 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.502918:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702de5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.502967:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.502981:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813142.503023:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788813142.503027:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788813142.503046:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.503070:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9c00/0xf32533d6ff702dde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296f1 expref: 20 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.503120:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702de5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296f1 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.503130:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:1.0:1788813142.503141:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813142.503145:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9400, rc 0) 00000100:00100000:1.0:1788813142.503205:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:11130:x1875706301680768:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 398us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813142.503624:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 51 00000100:00100000:2.0:1788813142.506455:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813142.506566:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301681024 00000100:00100000:1.0:1788813142.506579:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301681024 00000100:00100000:1.0:1788813142.506761:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 52 00000100:00100000:1.0:1788813142.506775:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:11130:x1875706301681024:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813142.506804:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813142.506873:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702dec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07296f8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.507059:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff702df3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.507076:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff702df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.507089:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff702df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813142.507112:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788813142.507274:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702dec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296f8 expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.507299:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff702df3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296f8 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.507309:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a455ee400) 00010000:00010000:1.0:1788813142.507313:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813142.507317:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dad600, rc 0) 00000100:00100000:1.0:1788813142.507541:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:11130:x1875706301681024:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 769us (1100us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788813142.507549:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 52 00000100:00100000:3.0:1788813142.513493:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813142.514817:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813142.514848:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301681408 00000100:00100000:3.0:1788813142.514860:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301681408 00000100:00100000:3.0:1788813142.514970:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:3.0:1788813142.514983:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76417100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:2398:x1875706301681408:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813142.515004:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813142.515049:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff702df3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296f8 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.515074:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a455ee400) 00010000:00010000:3.0:1788813142.515081:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813142.515157:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76417100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:2398:x1875706301681408:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 176us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813142.515165:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:2.0:1788813142.516435:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301681280 00000100:00100000:2.0:1788813142.516447:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301681280 00000100:00100000:2.0:1788813142.516571:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 53 00000100:00100000:2.0:1788813142.516582:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:11130:x1875706301681280:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813142.516623:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813142.516645:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702e01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07296ff expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.517304:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702e08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.517324:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702e08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.517337:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702e08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813142.517376:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788813142.517532:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702e01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296ff expref: 23 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.517553:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702e08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296ff expref: 22 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.517563:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a455ee400) 00010000:00010000:2.0:1788813142.517566:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788813142.517570:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08200, rc 0) 00000100:00100000:2.0:1788813142.517651:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:11130:x1875706301681280:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 1069us (4169us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788813142.517660:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 53 00000100:00100000:3.0:1788813142.523234:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813142.524222:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301681536 00000100:00100000:1.0:1788813142.524238:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301681536 00000100:00100000:0.0:1788813142.524506:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:0.0:1788813142.524586:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2398:x1875706301681536:12345-192.168.202.13@tcp:1:lfs.0 00010000:00010000:0.0:1788813142.524651:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff702e16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.524745:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.524756:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813142.524761:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813142.524767:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff702e16 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.524816:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.525188:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 7 pid: 8405 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813142.525209:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8404:1875706313295616:192.168.202.13@tcp:104: 00000100:00100000:0.0:1788813142.525370:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45b7a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813142.531018:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813142.531125:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301681664 00000100:00100000:2.0:1788813142.531145:0:8410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301681664 00002000:00100000:2.0:1788813142.531200:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff948a71410a80 x1875706301681664/t0(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:713/0 lens 504/0 e 0 to 0 dl 1788813153 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788813142.531213:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948a71410a80 with x1875706301681664 ext(0->12) 00010000:00010000:2.0:1788813142.531223:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 8 pid: 8405 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.531242:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 8 pid: 8405 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813142.531251:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff948a71410a80 00000100:00100000:2.0:1788813142.531282:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:2.0:1788813142.531309:0:8410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71410a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2396:x1875706301681664:12345-192.168.202.13@tcp:4:lfs.0 00000100:00100000:1.0:1788813142.533464:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8404:1875706313295616:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813142.533525:0:8404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff702e16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1788813142.544889:0:8399:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000100:00100000:0.0:1788813142.547230:0:8410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71410a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2396:x1875706301681664:12345-192.168.202.13@tcp:4:lfs.0 Request processed in 15911us (16216us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788813142.547249:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 0 00002000:00100000:0.0:1788813142.547263:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff948a71410a80 x1875706301681664/t4294967300(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:713/0 lens 504/448 e 0 to 0 dl 1788813153 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813142.547274:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948a71410a80 with x1875706301681664 ext(0->12) 00010000:00010000:0.0:1788813142.547285:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 9 pid: 8405 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.547306:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 9 pid: 8405 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813142.547313:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff948a71410a80 00000100:00100000:0.0:1788813142.552834:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813142.552978:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301681792 00000100:00100000:2.0:1788813142.552990:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301681792 00010000:00010000:2.0:1788813142.553030:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 9 pid: 8405 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813142.553385:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 53 00000100:00100000:2.0:1788813142.553396:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2397:x1875706301681792:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813142.553412:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788813142.553431:0:6479:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788813142.553434:0:6479:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788813142 00002000:00010000:2.0:1788813142.553437:0:6479:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788813143 00002000:00010000:2.0:1788813142.553439:0:6479:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788813142 00002000:00010000:2.0:1788813142.553441:0:6479:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788813142.553449:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 9 pid: 8405 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.553463:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 9 pid: 8405 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.553485:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff702dc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296e3 expref: 9 pid: 8405 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.553502:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813142.553507:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813142.553525:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff702e16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.553534:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff702e16 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.553570:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813142.553627:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2397:x1875706301681792:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 233us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813142.553635:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 53 00010000:00010000:0.0:1788813142.553700:0:8404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff702e16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.553710:0:8404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff702e16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.553742:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff702e16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.553750:0:8404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff702e16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.553758:0:8404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff702e16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.553766:0:8404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdaa00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813142.553770:0:8404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff702e16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.553778:0:8404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff702e16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.553793:0:8404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff702e16 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.553800:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff702e16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813142.553851:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2398:x1875706301681536:12345-192.168.202.13@tcp:1:lfs.0 Request processed in 29334us (30632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813142.553860:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:2.0:1788813142.557032:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813142.557442:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301682048 00000100:00100000:1.0:1788813142.557462:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301682048 00000100:00100000:1.0:1788813142.557556:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:1.0:1788813142.557568:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:11130:x1875706301682048:12345-192.168.202.13@tcp:35:lfs.0 00000004:00010000:1.0:1788813142.557670:0:6498:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702e08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296ff expref: 22 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788813142.558535:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1788813142.558605:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788813142.560426:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1788813142.560574:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702e1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.560602:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702dad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296d5 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.560613:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702e1d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.560737:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702dad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296d5 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.560757:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702dad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296d5 expref: 26 pid: 6496 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813142.560775:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1875706313295744:192.168.202.13@tcp:104: 00000100:00100000:1.0:1788813142.561426:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ebfd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813142.568534:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813142.569477:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301682176 00000100:00100000:3.0:1788813142.569491:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301682176 00010000:00010000:3.0:1788813142.569554:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702dad lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296d5 expref: 27 pid: 6496 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813142.569603:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 54 00000100:00100000:3.0:1788813142.569625:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:2397:x1875706301682176:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813142.569644:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813142.570335:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702dad lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296d5 expref: 27 pid: 6496 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.570392:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702dad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296d5 expref: 27 pid: 6496 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.570421:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a455ee400) 00010000:00010000:3.0:1788813142.570429:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702e1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.570441:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702e1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.570449:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702e1d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.570476:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813142.570567:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:2397:x1875706301682176:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 943us (2054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813142.570576:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 54 00010000:00010000:1.0:1788813142.571883:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8a00/0xf32533d6ff702dad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07296d5 expref: 26 pid: 6496 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813142.571910:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1875706313295744:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813142.571978:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702e1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.571989:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702e1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.571995:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702e1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788813142.572178:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1788813142.572311:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1788813142.572446:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313295872:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788813142.572531:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813142.572574:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813142.572626:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313295872 00000100:00100000:1.0:1788813142.572634:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313295872 00000100:00100000:1.0:1788813142.573812:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788813142.573828:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6498:x1875706313295872:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788813142.573987:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6498:x1875706313295872:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 163us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813142.573995:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788813142.574057:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313295872:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788813142.574745:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1788813142.574823:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313296000:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788813142.574921:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813142.575022:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ebfdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788813142.575433:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313296000 00000100:00100000:3.0:1788813142.575440:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313296000 00000100:00100000:3.0:1788813142.575521:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788813142.575530:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6498:x1875706313296000:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788813142.575700:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6498:x1875706313296000:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 171us (779us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788813142.575707:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788813142.575776:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313296000:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788813142.575828:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1788813142.575876:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702e1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.575888:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702e1d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.575897:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702e1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.575904:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813142.575909:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702e1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.575919:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702e1d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.575976:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a455ee400) 00010000:00010000:2.0:1788813142.575979:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788813142.575986:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702e1d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.575994:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff702e1d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788813142.576121:0:6498:0:(mdd_object.c:4199:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788813142.576207:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788813142.576220:0:6498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 295595286962ns, next at 296595284569ns, rc = 0 00000001:00080000:2.0:1788813142.576226:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1788813142.576247:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a455ee400) 00010000:00010000:2.0:1788813142.576250:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788813142.576257:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702e08 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296ff expref: 30 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813142.576380:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:11130:x1875706301682048:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 18814us (19357us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788813142.576388:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 8 00000020:00080000:2.0:1788813142.576393:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788813142.579927:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813142.583796:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301682304 00000100:00100000:3.0:1788813142.583814:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301682304 00000100:00100000:3.0:1788813142.583928:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 54 00000100:00100000:3.0:1788813142.583970:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:11130:x1875706301682304:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813142.584039:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813142.584069:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff702e24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729706 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.584163:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff702e24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729706 expref: 30 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.584182:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff702e24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729706 expref: 30 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.584207:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813142.584211:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813142.584216:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657800, rc 0) 00000100:00100000:3.0:1788813142.584292:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:11130:x1875706301682304:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 326us (4376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813142.584300:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 54 00000100:00100000:0.0:1788813142.588429:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813142.588529:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301682560 00000100:00100000:2.0:1788813142.588542:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301682560 00000100:00100000:2.0:1788813142.588725:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:2.0:1788813142.588739:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50e12050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:11130:x1875706301682560:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813142.589189:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50e12050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+31:11130:x1875706301682560:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 452us (772us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788813142.589211:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:2.0:1788813142.711153:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813142.711466:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301682816 00000100:00100000:1.0:1788813142.711479:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301682816 00000100:00100000:1.0:1788813142.711663:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 55 00000100:00100000:1.0:1788813142.711676:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+31:11140:x1875706301682816:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813142.711711:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813142.711737:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff702e2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072970d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813142.712232:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788813142.712507:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff702e2b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072970d expref: 33 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.712749:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764bee00) 00010000:00010000:1.0:1788813142.712753:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813142.712759:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff702e2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072970d expref: 33 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813142.712779:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dada00, rc 0) 00000100:00100000:1.0:1788813142.712917:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11140:x1875706301682816:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 1243us (1787us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1788813142.712926:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 55 00000100:00100000:0.0:1788813142.718762:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813142.719365:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301682944 00000100:00100000:3.0:1788813142.719378:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301682944 00000100:00100000:3.0:1788813142.719455:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 56 00000100:00100000:3.0:1788813142.719469:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11140:x1875706301682944:12345-192.168.202.13@tcp:34:lfs.0 00010000:00010000:3.0:1788813142.719722:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702e39 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.719745:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702e39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.719760:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702e39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.719795:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff702e40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.719803:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff702e40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.719810:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff702e40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.719958:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702e47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.719968:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702e47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.719975:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702e47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813142.720058:0:9156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702e47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720074:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702e39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720081:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702e39 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720088:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702e39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720105:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813142.720111:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702e39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720126:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702e39 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720150:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:3.0:1788813142.720154:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813142.720159:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702e39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720167:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702e39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720181:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff702e40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720187:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff702e40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720193:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff702e40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720199:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813142.720203:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff702e40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720209:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff702e40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720216:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a455eef00) 00010000:00010000:3.0:1788813142.720218:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813142.720221:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff702e40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720238:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff702e40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720250:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702e47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720257:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702e47 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720692:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702e47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720697:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813142.720700:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702e47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720707:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702e47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720716:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813142.720719:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813142.720722:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702e47 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813142.720728:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702e47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813142.721000:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11140:x1875706301682944:12345-192.168.202.13@tcp:34:lfs.0 Request processed in 1531us (2249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813142.721222:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 56 00000100:00100000:0.0:1788813142.724975:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813142.725267:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301683200 00000100:00100000:1.0:1788813142.725281:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301683200 00000100:00100000:1.0:1788813142.725366:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:1.0:1788813142.725378:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11140:x1875706301683200:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813142.725871:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+33:11140:x1875706301683200:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 494us (952us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788813142.725879:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:0.0:1788813142.800551:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813142.800911:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301683456 00000100:00100000:3.0:1788813142.800925:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301683456 00000100:00100000:2.0:1788813142.801372:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 57 00000100:00100000:2.0:1788813142.801389:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+33:11143:x1875706301683456:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813142.801420:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813142.801448:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702e4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729714 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.801548:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702e55 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.801566:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702e55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.801580:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702e55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.801592:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702e5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.801599:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702e5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.801618:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702e5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.801769:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702e63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.802673:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702e63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.802709:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702e63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813142.802725:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788813142.802840:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702e55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.802848:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702e55 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.802856:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702e55 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.802863:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813142.802869:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702e55 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.802877:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702e55 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.802892:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:2.0:1788813142.802896:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813142.802914:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702e55 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.802923:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702e55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.802961:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702e5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.802967:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702e5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.802980:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702e5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.802986:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813142.802989:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702e5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.802995:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702e5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.803003:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a455eef00) 00010000:00010000:2.0:1788813142.803005:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813142.803008:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702e5c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.803025:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702e5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.803079:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702e4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729714 expref: 36 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.803105:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702e63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729714 expref: 35 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813142.803113:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:2.0:1788813142.803114:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813142.803117:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09c00, rc 0) 00000100:00100000:2.0:1788813142.803216:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+35:11143:x1875706301683456:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 1831us (2679us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788813142.803232:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 57 00000100:00100000:1.0:1788813142.809692:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813142.810145:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301683584 00000100:00100000:0.0:1788813142.810159:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301683584 00000100:00100000:0.0:1788813142.810241:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 58 00000100:00100000:0.0:1788813142.810253:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+35:11143:x1875706301683584:12345-192.168.202.13@tcp:54:lfs.0 00010000:00010000:0.0:1788813142.810455:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702e71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.810479:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.810494:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.810541:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.810549:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702e71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.810557:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702e71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.810563:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdaa00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813142.810569:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702e71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.810578:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702e71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.810609:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:0.0:1788813142.810613:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788813142.810619:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702e71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813142.810625:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702e71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813142.810723:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+35:11143:x1875706301683584:12345-192.168.202.13@tcp:54:lfs.0 Request processed in 471us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813142.810731:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 58 00000100:00100000:0.0:1788813142.818584:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813142.818805:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301683840 00000100:00100000:2.0:1788813142.818819:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301683840 00000100:00100000:2.0:1788813142.818903:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:2.0:1788813142.818915:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+35:11143:x1875706301683840:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813142.819274:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+36:11143:x1875706301683840:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 359us (702us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788813142.819282:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:0.0:1788813142.889652:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64342680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313296128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813142.889750:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813142.891032:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313296128 00000100:00100000:3.0:1788813142.891046:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313296128 00000100:00100000:3.0:1788813142.891181:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788813142.891194:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313296128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788813142.891240:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788813142.891635:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313296128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 443us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813142.891643:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788813142.892445:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64342680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313296128:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788813143.014614:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813143.448546:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813143.448651:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301684096 00000100:00100000:3.0:1788813143.448665:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301684096 00000100:00100000:3.0:1788813143.448774:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 59 00000100:00100000:3.0:1788813143.448786:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+36:11174:x1875706301684096:12345-192.168.202.13@tcp:101:cat.0 00000100:00080000:0.0:1788813143.448930:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788813143.449105:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813143.449146:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702e78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072971b expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.449297:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff702e7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.449315:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff702e7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.449332:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff702e7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813143.449345:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788813143.449518:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702e78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072971b expref: 39 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.449565:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff702e7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072971b expref: 38 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.449576:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813143.449579:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813143.449584:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656000, rc 0) 00000100:00100000:3.0:1788813143.449666:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:11174:x1875706301684096:12345-192.168.202.13@tcp:101:cat.0 Request processed in 882us (1136us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788813143.449676:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 59 00000100:00100000:3.0:1788813143.455298:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813143.455411:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813143.455804:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301684480 00000100:00100000:2.0:1788813143.455830:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301684480 00000100:00100000:2.0:1788813143.455904:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12 00000100:00100000:2.0:1788813143.455917:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:11174:x1875706301684480:12345-192.168.202.13@tcp:35:cat.0 00000100:00100000:2.0:1788813143.456302:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+39:11174:x1875706301684480:12345-192.168.202.13@tcp:35:cat.0 Request processed in 386us (889us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788813143.456310:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12 00000100:00100000:0.0:1788813143.457341:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301684224 00000100:00100000:0.0:1788813143.457350:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301684224 00000100:00100000:0.0:1788813143.457404:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4 00000100:00100000:0.0:1788813143.457412:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64342a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+39:2397:x1875706301684224:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813143.457428:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813143.457458:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff702e7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072971b expref: 39 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813143.457483:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:0.0:1788813143.457489:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813143.457556:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64342a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:2397:x1875706301684224:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 144us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813143.457563:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4 00000100:00100000:0.0:1788813143.567998:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813143.568173:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301684736 00000100:00100000:2.0:1788813143.568187:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301684736 00000100:00100000:2.0:1788813143.568270:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 60 00000100:00100000:2.0:1788813143.568283:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:11180:x1875706301684736:12345-192.168.202.13@tcp:101:dd.0 00010000:00010000:2.0:1788813143.568319:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813143.568323:0:12571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788813143.568362:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9400/0xf32533d6ff702de5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296f1 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813143.568413:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:2.0:1788813143.568419:0:12571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813143.568439:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702e8d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729722 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813143.568587:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813143.568604:0:12571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702e63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729714 expref: 38 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813143.568614:0:12571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813143.568657:0:12571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702e63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729714 expref: 38 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813143.568674:0:12571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702e63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729714 expref: 38 pid: 12571 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813143.568689:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894365ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313296256:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813143.568839:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788813143.574243:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813143.574480:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894365ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313296256:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813143.574515:0:12571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813143.575162:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301684864 00000100:00100000:1.0:1788813143.575174:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301684864 00010000:00010000:1.0:1788813143.575227:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702e63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729714 expref: 39 pid: 12571 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813143.575296:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 55 00000100:00100000:1.0:1788813143.575309:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64343800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+39:2397:x1875706301684864:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813143.575331:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813143.575400:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702e63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729714 expref: 39 pid: 12571 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813143.575486:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702e63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729714 expref: 39 pid: 12571 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813143.575513:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff702e63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729714 expref: 39 pid: 12571 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813143.575532:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813143.575537:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813143.575548:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813143.575555:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813143.575644:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813143.575719:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64343800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:2397:x1875706301684864:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 412us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813143.575727:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 55 00010000:00010000:2.0:1788813143.578339:0:12571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813143.578486:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813143.578515:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788813143.579001:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702e8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729722 expref: 39 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813143.579178:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729722 expref: 38 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813143.579190:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:2.0:1788813143.579194:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788813143.579198:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08e00, rc 0) 00000100:00100000:2.0:1788813143.579291:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:11180:x1875706301684736:12345-192.168.202.13@tcp:101:dd.0 Request processed in 11009us (11356us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788813143.579302:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 60 00000100:00100000:3.0:1788813143.588500:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813143.589064:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301684992 00000100:00100000:0.0:1788813143.589079:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301684992 00000001:00080000:2.0:1788813143.589380:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000004:00080000:2.0:1788813143.589410:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788813143.589432:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff948a50cdbcc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788813143.589437:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948942d7fe00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff948a50cdb3c0 00000020:00080000:2.0:1788813143.589441:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948942d7f200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff948a6fe08a00 00000020:00080000:2.0:1788813143.589508:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788813143.589751:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788813143.590394:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 61 00000100:00100000:0.0:1788813143.590413:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+13:11180:x1875706301684992:12345-192.168.202.13@tcp:101:dd.0 00010000:00010000:0.0:1788813143.590446:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813143.590473:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702ea2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729729 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813143.590520:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702ea9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813143.590540:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813143.590555:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813143.591013:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313296384:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788813143.591221:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702d60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591231:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702d60 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591238:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702d60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591245:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813143.591250:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702d60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591259:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702d60 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591286:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff948a455ee200) 00010000:00010000:3.0:1788813143.591290:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813143.591296:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702d60 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591304:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8600/0xf32533d6ff702d60 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591326:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702d67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591332:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702d67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591337:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702d67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591352:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813143.591355:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702d67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591361:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702d67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591370:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:3.0:1788813143.591372:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813143.591376:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702d67 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591382:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8800/0xf32533d6ff702d67 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591409:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702da6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591416:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702da6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591422:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702da6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591428:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813143.591431:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702da6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591438:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702da6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591446:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a455eef00) 00010000:00010000:3.0:1788813143.591448:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813143.591451:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702da6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813143.591457:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9a00/0xf32533d6ff702da6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813143.593959:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702ea2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729729 expref: 13 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813143.594002:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729729 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813143.594013:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:0.0:1788813143.594017:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788813143.594328:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdaa00, rc 0) 00000100:00100000:0.0:1788813143.594457:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+12:11180:x1875706301684992:12345-192.168.202.13@tcp:101:dd.0 Request processed in 4047us (5971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813143.594468:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 61 00000100:00100000:3.0:1788813143.601538:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813143.603722:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313296384 00000100:00100000:2.0:1788813143.603762:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313296384 00000100:00100000:1.0:1788813143.604058:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788813143.604080:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64340a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313296384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788813143.604370:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1788813143.604418:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f1f56, atime: 0x6a9f1f57, ctime: 0x6a9f1f56, blocks: 0x8 00010000:00010000:1.0:1788813143.604428:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff702eb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813143.604448:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=296s v=(0 0) 00010000:00010000:1.0:1788813143.604454:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813143.604461:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff702eb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813143.604483:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff702eb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813143.604495:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff702eb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813143.604504:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff702eb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813143.604532:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813143.604763:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813143.604783:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff702eb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813143.604793:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac800 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813143.604798:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff702eb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813143.604809:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff702eb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813143.604842:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff702eb0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813143.604851:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff702eb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813143.604876:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813143.604878:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813143.604880:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813143.605863:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64340a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3628:x1875706313296384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1782us (4330us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788813143.605874:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:3.0:1788813143.610351:0:3628:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94894365ad80/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788813143.610373:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313296384:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788813143.610608:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813143.610765:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301685248 00000100:00100000:3.0:1788813143.610877:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301685248 00000100:00100000:2.0:1788813143.611218:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 62 00000100:00100000:2.0:1788813143.611231:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+12:11180:x1875706301685248:12345-192.168.202.13@tcp:36:dd.0 00010000:00010000:2.0:1788813143.611574:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702eb7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813143.611597:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813143.611612:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813143.611676:0:9156:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1788813143.611701:0:9156:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098aed2e2 reply state 00000000004e6b9b transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813143.611716:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702eb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813143.611725:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:2.0:1788813143.611728:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788813143.611734:0:9156:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813143.612245:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:11180:x1875706301685248:12345-192.168.202.13@tcp:36:dd.0 Request processed in 1014us (1637us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788813143.612255:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 62 00000020:00080000:2.0:1788813143.612262:0:9156:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788813144.037275:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813144.180815:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813144.180923:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301685376 00000100:00100000:3.0:1788813144.180971:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301685376 00000100:00100000:3.0:1788813144.181072:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:3.0:1788813144.181085:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:11194:x1875706301685376:12345-192.168.202.13@tcp:101:stat.0 00010000:00010000:3.0:1788813144.181126:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813144.181156:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702ebe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729730 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.181430:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702ec5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.181451:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702ec5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.181466:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702ec5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.181486:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702ecc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.181494:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702ecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.181501:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702ecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.181591:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702ed3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.181605:0:12571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729722 expref: 16 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.181636:0:12571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702ed3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.181679:0:12571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729722 expref: 16 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.181695:0:12571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729722 expref: 16 pid: 12571 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813144.181711:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64342680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313296512:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813144.182204:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943306b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813144.184720:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813144.184858:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64342680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313296512:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813144.184891:0:12571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702ed3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813144.189672:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301685632 00000100:00100000:0.0:1788813144.189693:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301685632 00000100:00100000:0.0:1788813144.189796:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:0.0:1788813144.189810:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+17:6156:x1875706301685632:12345-192.168.202.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788813144.190728:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:6156:x1875706301685632:12345-192.168.202.13@tcp:35:ldlm_bl.0 Request processed in 917us (6016us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788813144.190739:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:2.0:1788813144.195725:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813144.195832:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301685760 00000100:00100000:3.0:1788813144.195846:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301685760 00010000:00010000:3.0:1788813144.195899:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729722 expref: 18 pid: 12571 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813144.195993:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 56 00000100:00100000:3.0:1788813144.196004:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:2396:x1875706301685760:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813144.196023:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813144.196031:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729722 expref: 18 pid: 12571 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.196045:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729722 expref: 18 pid: 12571 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.196108:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702e94 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729722 expref: 18 pid: 12571 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.196135:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813144.196142:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702ed3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.196154:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.196163:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702ed3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.196200:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813144.196275:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+17:2396:x1875706301685760:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 272us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813144.196283:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 56 00010000:00010000:2.0:1788813144.196402:0:12571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196412:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813144.196483:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788813144.196488:0:12571:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788813144.196539:0:12571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196555:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196565:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702ec5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196572:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702ec5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196579:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196586:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813144.196591:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196599:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702ec5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196607:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:2.0:1788813144.196618:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813144.196623:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702ec5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196630:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff702ec5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196642:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702ecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196648:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702ecc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196654:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702ecc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196659:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813144.196662:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702ecc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196668:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702ecc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196675:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a764beb00) 00010000:00010000:2.0:1788813144.196678:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813144.196681:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702ecc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196688:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff702ecc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196732:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff702ebe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729730 expref: 17 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196758:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729730 expref: 16 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.196765:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:2.0:1788813144.196768:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813144.196770:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657000, rc 0) 00000100:00100000:2.0:1788813144.196802:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:11194:x1875706301685376:12345-192.168.202.13@tcp:101:stat.0 Request processed in 15721us (16002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813144.196810:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:2.0:1788813144.377033:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813144.379891:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301686016 00000100:00100000:0.0:1788813144.379915:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301686016 00000100:00100000:0.0:1788813144.380074:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 64 00000100:00100000:0.0:1788813144.380099:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:11200:x1875706301686016:12345-192.168.202.13@tcp:36:truncate.0 00010000:00010000:0.0:1788813144.380211:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813144.380247:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff702ed3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729730 expref: 16 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813144.380274:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:0.0:1788813144.380280:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813144.380508:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702eda lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813144.380526:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702eda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813144.380539:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702eda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813144.380591:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1788813144.380625:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000187a5baa reply state 0000000084d01c73 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702eda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813144.380640:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702eda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813144.381207:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:0.0:1788813144.381210:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788813144.381214:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813144.381718:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:11200:x1875706301686016:12345-192.168.202.13@tcp:36:truncate.0 Request processed in 1618us (4696us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788813144.381745:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 64 00000020:00080000:0.0:1788813144.381753:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788813144.451058:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813144.451107:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813144.451165:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813144.451180:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301686272 00000100:00100000:3.0:1788813144.451194:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301686272 00000100:00100000:1.0:1788813144.451201:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813144.451225:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301686400 00000100:00100000:1.0:1788813144.451228:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301686400 00000100:00100000:3.0:1788813144.451263:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301686528 00000100:00100000:3.0:1788813144.451265:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301686528 00000100:00100000:1.0:1788813144.451268:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 96 00000100:00100000:1.0:1788813144.451280:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2397:x1875706301686400:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813144.451288:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 253 00000100:00100000:3.0:1788813144.451295:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301686272:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813144.451387:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 254 00000100:00100000:2.0:1788813144.451397:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301686528:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813144.451470:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2397:x1875706301686400:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 191us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813144.451478:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 96 00000100:00100000:3.0:1788813144.451544:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301686272:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 249us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813144.451551:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 253 00000100:00100000:0.0:1788813144.451561:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301686144 00000100:00100000:0.0:1788813144.451565:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301686144 00000100:00080000:3.0:1788813144.451570:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813144.451592:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813144.451595:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813144.451603:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 369 00000100:00100000:0.0:1788813144.451610:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2397:x1875706301686144:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813144.451639:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2397:x1875706301686144:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 30us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813144.451662:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 369 00000100:00100000:2.0:1788813144.460112:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301686528:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 8698us (8985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813144.460144:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 254 00000100:00100000:0.0:1788813144.469231:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813144.469618:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301686656 00000100:00100000:1.0:1788813144.469633:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301686656 00000100:00100000:1.0:1788813144.470053:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 255 00000100:00100000:1.0:1788813144.470066:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301686656:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813144.470177:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301686656:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 114us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813144.470186:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 255 00000100:00080000:0.0:1788813144.470432:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788813144.734557:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813144.740568:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301686784 00000100:00100000:3.0:1788813144.740583:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301686784 00000100:00100000:3.0:1788813144.740666:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:3.0:1788813144.740688:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:11214:x1875706301686784:12345-192.168.202.13@tcp:101:stat.0 00010000:00010000:3.0:1788813144.740720:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813144.740744:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff702ee1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729737 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.740807:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702ee8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741037:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702ee8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741051:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702ee8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741068:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702eef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741076:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741092:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741407:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff702ef6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741417:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff702ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741437:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff702ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813144.741480:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788813144.741485:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813144.741508:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff702ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741520:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff702ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741529:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702ee8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741536:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702ee8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741543:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702ee8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741549:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813144.741554:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702ee8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741562:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702ee8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741575:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:3.0:1788813144.741579:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813144.741583:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702ee8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741599:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702ee8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741612:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741617:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702eef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741622:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702eef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741627:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813144.741630:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702eef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741635:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702eef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741642:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a764bea00) 00010000:00010000:3.0:1788813144.741644:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813144.741647:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702eef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741652:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702eef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741767:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff702ee1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729737 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741784:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff702ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729737 expref: 19 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813144.741798:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813144.741801:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813144.741803:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657600, rc 0) 00000100:00100000:3.0:1788813144.742038:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:11214:x1875706301686784:12345-192.168.202.13@tcp:101:stat.0 Request processed in 1362us (7489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813144.742045:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:3.0:1788813144.889351:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813144.889495:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301687040 00000100:00100000:2.0:1788813144.889504:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301687040 00000100:00100000:2.0:1788813144.889560:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 66 00000100:00100000:2.0:1788813144.889568:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:11224:x1875706301687040:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813144.889586:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813144.889602:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702efd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072973e expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813144.889682:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788813144.889781:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702efd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072973e expref: 21 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.889792:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764bee00) 00010000:00010000:2.0:1788813144.889794:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813144.889798:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702efd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072973e expref: 21 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813144.889808:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08e00, rc 0) 00000100:00100000:2.0:1788813144.889862:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:11224:x1875706301687040:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 294us (518us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788813144.889869:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 66 00000100:00100000:0.0:1788813144.907037:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813144.909896:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301687296 00000100:00100000:1.0:1788813144.909912:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301687296 00000100:00100000:1.0:1788813144.910021:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00100000:1.0:1788813144.910032:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:11224:x1875706301687296:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813144.910296:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:11224:x1875706301687296:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 265us (3267us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1788813144.910304:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00100000:3.0:1788813145.051342:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813145.051494:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301687552 00000100:00100000:2.0:1788813145.051505:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301687552 00000100:00100000:2.0:1788813145.051587:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:2.0:1788813145.051598:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:11231:x1875706301687552:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:2.0:1788813145.051621:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813145.051643:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702f0b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729745 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.051754:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.051770:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff702ef6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729737 expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.051779:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.051828:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff702ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729737 expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788813145.051963:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788813145.052044:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff702ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729737 expref: 22 pid: 6496 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813145.052058:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943698000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1875706313296640:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813145.052310:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a46c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788813145.060636:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813145.078472:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813145.078622:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301687680 00000100:00100000:1.0:1788813145.078644:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301687680 00010000:00010000:1.0:1788813145.078687:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff702ef6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729737 expref: 23 pid: 6496 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813145.078727:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 57 00000100:00100000:1.0:1788813145.078737:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50685450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+23:2396:x1875706301687680:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813145.078750:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813145.078756:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff702ef6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729737 expref: 23 pid: 6496 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813145.078769:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff702ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729737 expref: 23 pid: 6496 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813145.078789:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813145.078795:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813145.078804:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813145.078812:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813145.078830:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813145.078899:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50685450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+23:2396:x1875706301687680:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 162us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813145.078907:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 57 00010000:00010000:2.0:1788813145.079369:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff702ef6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729737 expref: 22 pid: 6496 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813145.079397:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943698000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1875706313296640:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813145.079422:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.079432:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.079439:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813145.079457:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788813145.079592:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff702f0b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729745 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.079608:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729745 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.079625:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:2.0:1788813145.079629:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788813145.079631:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08200, rc 0) 00000100:00100000:2.0:1788813145.079675:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:11231:x1875706301687552:12345-192.168.202.13@tcp:101:bash.0 Request processed in 28078us (28342us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788813145.079683:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:0.0:1788813145.097897:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813145.098202:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301687936 00000100:00100000:3.0:1788813145.098220:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301687936 00000100:00100000:3.0:1788813145.098311:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 68 00000100:00100000:3.0:1788813145.098324:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:11231:x1875706301687936:12345-192.168.202.13@tcp:36:bash.0 00010000:00010000:3.0:1788813145.099797:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702f20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.099924:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.099950:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813145.100023:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1788813145.100063:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ac6b4b5 reply state 0000000003fd3ca0 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.100394:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702f20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.100426:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813145.100430:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788813145.100436:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813145.101921:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:11231:x1875706301687936:12345-192.168.202.13@tcp:36:bash.0 Request processed in 3587us (4019us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1788813145.101947:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 68 00000020:00080000:3.0:1788813145.101956:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788813145.132158:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813145.133136:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301688064 00000100:00100000:1.0:1788813145.133153:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301688064 00000100:00100000:1.0:1788813145.135288:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 69 00000100:00100000:1.0:1788813145.135320:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:11231:x1875706301688064:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:1.0:1788813145.135358:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813145.135400:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff702f27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072974c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813145.135561:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff702f2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813145.135592:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729745 expref: 26 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813145.135603:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff702f2e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813145.135659:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729745 expref: 26 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813145.135678:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729745 expref: 26 pid: 6494 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813145.135695:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313296768:192.168.202.13@tcp:104: 00000100:00100000:1.0:1788813145.135852:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813145.148482:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313296768:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813145.148528:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff702f2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813145.150048:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813145.155731:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301688192 00000100:00100000:3.0:1788813145.155753:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301688192 00010000:00010000:2.0:1788813145.156247:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729745 expref: 27 pid: 6494 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813145.156307:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 58 00000100:00100000:2.0:1788813145.156320:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943698000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:2396:x1875706301688192:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813145.156342:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813145.156350:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729745 expref: 27 pid: 6494 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.156366:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729745 expref: 27 pid: 6494 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.156405:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff702f12 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729745 expref: 27 pid: 6494 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.156426:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:2.0:1788813145.156432:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff702f2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.156897:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff702f2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.156908:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff702f2e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.157058:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813145.157161:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943698000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+26:2396:x1875706301688192:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 843us (7119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813145.157171:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 58 00010000:00010000:0.0:1788813145.157260:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff702f2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.157269:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff702f2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813145.157337:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788813145.157342:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813145.157368:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff702f2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.157416:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff702f27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072974c expref: 26 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.157454:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff702f2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072974c expref: 25 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.157471:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:0.0:1788813145.157474:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813145.157476:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac600, rc 0) 00000100:00100000:0.0:1788813145.157507:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:11231:x1875706301688064:12345-192.168.202.13@tcp:101:bash.0 Request processed in 22205us (25365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813145.157515:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 69 00000100:00100000:0.0:1788813145.171830:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813145.172347:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301688448 00000100:00100000:1.0:1788813145.172391:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301688448 00000100:00100000:1.0:1788813145.172475:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:1.0:1788813145.172489:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50e12450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:11231:x1875706301688448:12345-192.168.202.13@tcp:35:bash.0 00000100:00100000:1.0:1788813145.173010:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50e12450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+26:11231:x1875706301688448:12345-192.168.202.13@tcp:35:bash.0 Request processed in 522us (1205us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788813145.173020:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:3.0:1788813145.295433:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813145.296137:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301688704 00000100:00100000:2.0:1788813145.296151:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301688704 00000100:00100000:2.0:1788813145.296401:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 70 00000100:00100000:2.0:1788813145.296415:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+26:11241:x1875706301688704:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813145.296450:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813145.296476:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702f35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729753 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813145.296827:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788813145.297002:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702f35 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729753 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.297019:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764bee00) 00010000:00010000:2.0:1788813145.297024:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813145.297029:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702f35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729753 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.297046:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09000, rc 0) 00000100:00100000:2.0:1788813145.298868:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:11241:x1875706301688704:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 2441us (3436us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1788813145.298883:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 70 00000100:00100000:2.0:1788813145.317444:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813145.318295:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301688832 00000100:00100000:3.0:1788813145.318311:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301688832 00000100:00100000:3.0:1788813145.318456:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 71 00000100:00100000:3.0:1788813145.318469:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:11241:x1875706301688832:12345-192.168.202.13@tcp:34:lfs.0 00010000:00010000:3.0:1788813145.318827:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff702f43 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.318851:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff702f43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.318867:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff702f43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.318885:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702f4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.318893:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.318923:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.319048:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff702f51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.319058:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff702f51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.319066:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff702f51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813145.319142:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff702f51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.319160:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff702f43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.319167:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff702f43 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.319175:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff702f43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320292:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813145.320305:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff702f43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320319:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff702f43 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320409:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:3.0:1788813145.320427:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813145.320436:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff702f43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320444:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff702f43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320463:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320470:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702f4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320478:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702f4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320484:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813145.320499:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702f4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320506:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702f4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320516:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a764bea00) 00010000:00010000:3.0:1788813145.320519:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813145.320531:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702f4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320813:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702f4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320835:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff702f51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320850:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff702f51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320857:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff702f51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320863:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813145.320866:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff702f51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320873:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff702f51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320882:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813145.320885:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813145.320888:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff702f51 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.320894:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff702f51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813145.324316:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:11241:x1875706301688832:12345-192.168.202.13@tcp:34:lfs.0 Request processed in 5829us (6865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813145.324347:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 71 00000100:00100000:0.0:1788813145.326904:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813145.327767:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301689088 00000100:00100000:2.0:1788813145.327783:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301689088 00000100:00100000:2.0:1788813145.328343:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:2.0:1788813145.328359:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:11241:x1875706301689088:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813145.328707:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+28:11241:x1875706301689088:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 353us (1817us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788813145.328716:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:3.0:1788813145.392386:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813145.392795:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301689344 00000100:00100000:0.0:1788813145.392812:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301689344 00000100:00100000:0.0:1788813145.392910:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:0.0:1788813145.395020:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+28:11244:x1875706301689344:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813145.395075:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813145.395121:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702f58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072975a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.396813:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702f5f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.396849:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702f5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.396867:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702f5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.396915:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702f66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.396924:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702f66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.396948:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702f66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397148:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff702f6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397160:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff702f6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397175:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff702f6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813145.397192:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788813145.397292:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702f5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397300:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702f5f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397306:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702f5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397312:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813145.397316:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702f5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397345:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702f5f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397359:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:0.0:1788813145.397363:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813145.397368:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702f5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397374:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff702f5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397389:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702f66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397394:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702f66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397399:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702f66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397404:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813145.397406:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702f66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397411:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702f66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397417:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a74a15200) 00010000:00010000:0.0:1788813145.397419:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813145.397421:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702f66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397434:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff702f66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397498:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff702f58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072975a expref: 31 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397514:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff702f6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072975a expref: 30 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.397521:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:0.0:1788813145.397524:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813145.397526:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e5800, rc 0) 00000100:00100000:0.0:1788813145.397625:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:11244:x1875706301689344:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 2632us (5253us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788813145.397633:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:0.0:1788813145.401065:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813145.401127:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813145.401194:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301689600 00000100:00100000:3.0:1788813145.401208:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301689600 00000100:00100000:3.0:1788813145.401280:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:3.0:1788813145.401293:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:2397:x1875706301689600:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813145.401314:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813145.401343:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff702f6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072975a expref: 30 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813145.401398:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813145.401406:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813145.401477:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:2397:x1875706301689600:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 187us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813145.401486:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:2.0:1788813145.402434:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301689472 00000100:00100000:2.0:1788813145.402443:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301689472 00000100:00100000:2.0:1788813145.403730:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 73 00000100:00100000:2.0:1788813145.403753:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:11244:x1875706301689472:12345-192.168.202.13@tcp:54:lfs.0 00010000:00010000:2.0:1788813145.403853:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702f7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.403875:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702f7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.403890:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702f7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.403952:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702f7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.403980:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702f7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.403987:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702f7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.403993:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813145.403998:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702f7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.404006:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702f7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.404021:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:2.0:1788813145.404024:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813145.404029:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702f7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.404035:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702f7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813145.404141:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:11244:x1875706301689472:12345-192.168.202.13@tcp:54:lfs.0 Request processed in 398us (3088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813145.404151:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 73 00000100:00100000:1.0:1788813145.406897:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813145.407149:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301689856 00000100:00100000:3.0:1788813145.407173:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301689856 00000100:00100000:3.0:1788813145.407252:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:3.0:1788813145.407265:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:11244:x1875706301689856:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:3.0:1788813145.407968:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:11244:x1875706301689856:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 702us (1082us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788813145.407978:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:2.0:1788813145.445043:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813145.445077:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313296896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813145.445218:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813145.445517:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313296896 00000100:00100000:3.0:1788813145.445543:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313296896 00000100:00100000:3.0:1788813145.445601:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788813145.445609:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313296896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788813145.445649:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446297600 avail 1300058112 00000100:00100000:3.0:1788813145.445693:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313296896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813145.445699:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788813145.445847:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313297152:0@lo:400:kworker.0 00000100:00100000:3.0:1788813145.445886:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813145.445911:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313297664:0@lo:400:kworker.0 00000100:00100000:3.0:1788813145.445963:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813145.446005:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1875706313298176:0@lo:400:kworker.0 00000100:00100000:3.0:1788813145.446031:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813145.446053:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788813145.446061:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313297280:0@lo:400:kworker.0 00000100:00100000:3.0:1788813145.446083:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813145.446099:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313297792:0@lo:400:kworker.0 00000100:00100000:3.0:1788813145.446137:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813145.446158:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313298304:0@lo:400:kworker.0 00000100:00100000:3.0:1788813145.446181:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813145.446216:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313297792 00000100:00100000:3.0:1788813145.446221:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313297792 00000100:00100000:3.0:1788813145.446258:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313298304 00000100:00100000:3.0:1788813145.446262:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313298304 00000100:00100000:3.0:1788813145.446284:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788813145.446292:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313297792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813145.446333:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313297792:12345-0@lo:400:kworker.0 Request processed in 42us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813145.446340:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788813145.446354:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788813145.446360:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313298304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813145.446388:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313298304:12345-0@lo:400:kworker.0 Request processed in 29us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813145.446394:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788813145.446443:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313297792:0@lo:400:kworker.0 00000100:00100000:3.0:1788813145.446455:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313298304:0@lo:400:kworker.0 00000100:00100000:2.0:1788813145.448411:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313297024:0@lo:400:kworker.0 00000100:00100000:2.0:1788813145.448507:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788813145.448826:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813145.448833:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813145.448855:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313297152 00000100:00100000:0.0:1788813145.448864:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313297152 00000100:00100000:0.0:1788813145.448929:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313297664 00000100:00100000:0.0:1788813145.448975:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313297664 00000100:00080000:0.0:1788813145.448995:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813145.449013:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313298176 00000100:00100000:0.0:1788813145.449016:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313298176 00000100:00080000:0.0:1788813145.449044:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813145.449059:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313297280 00000100:00100000:0.0:1788813145.449062:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313297280 00000100:00100000:0.0:1788813145.449087:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788813145.449096:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313297152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813145.449180:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313297152:12345-0@lo:400:kworker.0 Request processed in 86us (3294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813145.449188:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788813145.449238:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313297152:0@lo:400:kworker.0 00000100:00100000:0.0:1788813145.449267:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788813145.449275:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313297664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813145.449313:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313297664:12345-0@lo:400:kworker.0 Request processed in 40us (3350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813145.449320:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00010000:00080000:0.0:1788813145.449349:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943530000 x1875706313297664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813145.449362:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313297664:0@lo:400:kworker.0 00000100:00100000:0.0:1788813145.449381:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788813145.449388:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875706313298176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813145.449444:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875706313298176:12345-0@lo:400:kworker.0 Request processed in 57us (3412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813145.449451:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00010000:00080000:0.0:1788813145.449477:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948943531880 x1875706313298176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813145.449501:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1875706313298176:0@lo:400:kworker.0 00000100:00100000:0.0:1788813145.449529:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788813145.450888:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313297408:0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.450967:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813145.451017:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313297920:0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.451057:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813145.451081:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313298432:0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.451102:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813145.451146:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813145.451154:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313298560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813145.451178:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813145.451214:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313297408 00000100:00100000:1.0:1788813145.451221:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313297408 00000100:00100000:1.0:1788813145.451270:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788813145.451280:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313297408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.451333:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313297408:12345-0@lo:400:kworker.0 Request processed in 55us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813145.451341:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788813145.451369:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313297920 00000100:00100000:1.0:1788813145.451373:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313297920 00000100:00100000:2.0:1788813145.451652:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313297536:0@lo:400:kworker.0 00000100:00100000:2.0:1788813145.451688:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813145.451700:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313298048:0@lo:400:kworker.0 00000100:00100000:2.0:1788813145.451720:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813145.452887:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313298432 00000100:00100000:1.0:1788813145.452913:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313298432 00000100:00100000:1.0:1788813145.452957:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788813145.452966:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3625:x1875706313297920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.453035:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3625:x1875706313297920:12345-0@lo:400:kworker.0 Request processed in 71us (1977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813145.453040:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788813145.453054:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788813145.453058:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313298432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.453077:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313298432:12345-0@lo:400:kworker.0 Request processed in 19us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813145.453081:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788813145.453197:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313298560 00000100:00100000:1.0:1788813145.453201:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313298560 00000100:00100000:1.0:1788813145.453228:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788813145.453235:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313298560:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813145.453252:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313296896:0@lo:41:osp-pre-0-1.0 00002000:00000024:1.0:1788813145.453258:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813145.453288:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313297536 00000100:00100000:1.0:1788813145.453291:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313298560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813145.453292:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313297536 00000100:00100000:1.0:1788813145.453298:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788813145.453354:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313298560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813145.453367:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313297408:0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.453378:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313297920:0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.453387:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313298432:0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.453417:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313298688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813145.453470:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813145.453509:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313297024 00000100:00100000:1.0:1788813145.453514:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313298688 00000100:00100000:1.0:1788813145.453518:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313298688 00000100:00100000:0.0:1788813145.453519:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313297024 00000100:00100000:0.0:1788813145.453553:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788813145.453560:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a61094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313297024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813145.453610:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a61094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313297024:12345-0@lo:400:kworker.0 Request processed in 51us (5103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813145.453616:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00080000:0.0:1788813145.453647:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813145.453652:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813145.453655:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813145.453666:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313298048 00000100:00100000:0.0:1788813145.453670:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313298048 00000100:00080000:0.0:1788813145.453685:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813145.454691:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788813145.454704:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313298688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788813145.454791:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813145.454852:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313298688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 152us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813145.454858:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788813145.454909:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313298688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813145.454979:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313297280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.455023:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313297280:12345-0@lo:400:kworker.0 Request processed in 1528us (8938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813145.455748:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313297024:0@lo:400:kworker.0 00000100:00100000:2.0:1788813145.460491:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788813145.460525:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313297536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813145.460674:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313297536:12345-0@lo:400:kworker.0 Request processed in 167us (8984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813145.460682:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788813145.460749:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313297536:0@lo:400:kworker.0 00000100:00100000:0.0:1788813145.460896:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788813145.460910:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894369a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313298048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813145.460970:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894369a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313298048:12345-0@lo:400:kworker.0 Request processed in 65us (9248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813145.460977:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788813145.461032:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313297280:0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.461183:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788813145.461397:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313298048:0@lo:400:kworker.0 00000100:00100000:3.0:1788813145.645270:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813145.645603:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301690112 00000100:00100000:2.0:1788813145.645619:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301690112 00000100:00100000:2.0:1788813145.645781:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 74 00000100:00100000:2.0:1788813145.645794:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:11262:x1875706301690112:12345-192.168.202.13@tcp:101:cat.0 00010000:00010000:2.0:1788813145.645848:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813145.645876:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702f82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729761 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.646069:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702f89 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.646090:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702f89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.646133:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702f89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813145.646148:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788813145.649701:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702f82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729761 expref: 33 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.649753:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702f89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729761 expref: 32 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.649763:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:2.0:1788813145.649767:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788813145.649771:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08800, rc 0) 00000100:00100000:2.0:1788813145.650839:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11262:x1875706301690112:12345-192.168.202.13@tcp:101:cat.0 Request processed in 5040us (5577us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1788813145.650911:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 74 00000100:00100000:3.0:1788813145.689638:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813145.690082:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301690240 00000100:00100000:0.0:1788813145.690102:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301690240 00000100:00100000:0.0:1788813145.690197:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 75 00000100:00100000:0.0:1788813145.690555:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11263:x1875706301690240:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813145.690587:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813145.690614:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff702f97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729768 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.690708:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff702f9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.690744:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff702f9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.690759:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff702f9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813145.690823:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788813145.690828:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813145.691149:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff702f9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.691185:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff702f97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729768 expref: 34 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.691208:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff702f9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729768 expref: 33 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.694815:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:0.0:1788813145.694821:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813145.694826:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166ec00, rc 0) 00000100:00100000:0.0:1788813145.696203:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+33:11263:x1875706301690240:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 4386us (5315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813145.696217:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 75 00000100:00100000:1.0:1788813145.701448:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813145.702100:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301690624 00000100:00100000:3.0:1788813145.702125:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301690624 00000100:00100000:3.0:1788813145.702211:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:3.0:1788813145.702224:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+33:11263:x1875706301690624:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:3.0:1788813145.702647:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+34:11263:x1875706301690624:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 425us (1212us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788813145.702656:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:1.0:1788813145.712084:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813145.712329:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301690752 00000100:00100000:0.0:1788813145.712342:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301690752 00000100:00100000:0.0:1788813145.712434:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00100000:0.0:1788813145.712447:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943498380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+34:11263:x1875706301690752:12345-192.168.202.13@tcp:103:lfs.0 00010000:00010000:0.0:1788813145.712468:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788813145.712518:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff702f2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072974c expref: 34 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.712545:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff702f89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729761 expref: 33 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.712559:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff702e24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729706 expref: 32 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.712570:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:0.0:1788813145.712575:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813145.712660:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943498380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+31:11263:x1875706301690752:12345-192.168.202.13@tcp:103:lfs.0 Request processed in 216us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813145.712667:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00100000:1.0:1788813145.715337:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813145.715577:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301690880 00000100:00100000:0.0:1788813145.715589:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301690880 00000100:00100000:0.0:1788813145.715675:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 76 00000100:00100000:0.0:1788813145.715687:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+31:11263:x1875706301690880:12345-192.168.202.13@tcp:58:lfs.0 00010000:00010000:2.0:1788813145.716435:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702fa5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.716460:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702fa5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813145.716474:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702fa5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813145.716858:0:9156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813145.717197:0:9156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788813145.717300:0:9156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788813145.717598:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+31:11263:x1875706301690880:12345-192.168.202.13@tcp:58:lfs.0 Request processed in 1905us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813145.717618:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 76 00000100:00100000:2.0:1788813145.776174:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813145.776896:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301691008 00000100:00100000:0.0:1788813145.776911:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301691008 00000100:00100000:0.0:1788813145.777216:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 77 00000100:00100000:0.0:1788813145.777232:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+31:11265:x1875706301691008:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813145.777262:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813145.777310:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff702fac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072976f expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.777435:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fb3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.777460:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.777475:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.777494:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff702fba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.777502:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff702fba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.777509:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff702fba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.777838:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff702fc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.777850:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff702fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.777859:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff702fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813145.777915:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788813145.777920:0:12571:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813145.777976:0:12571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff702fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.777991:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff702fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778266:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778273:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fb3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778281:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778288:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166fc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813145.778293:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778412:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fb3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778430:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:0.0:1788813145.778433:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813145.778441:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fb3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778448:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fb3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778466:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff702fba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778473:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff702fba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778479:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff702fba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778492:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813145.778495:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff702fba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778502:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff702fba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778511:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a74a15200) 00010000:00010000:0.0:1788813145.778513:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813145.778635:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff702fba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778647:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff702fba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778693:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff702fac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072976f expref: 33 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778708:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff702fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072976f expref: 32 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813145.778716:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:0.0:1788813145.778719:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813145.778722:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f600, rc 0) 00000100:00100000:0.0:1788813145.780158:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11265:x1875706301691008:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 1593us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813145.780181:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 77 00010000:00010000:1.0:1788813146.090068:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788813146.090512:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813146.090520:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813146.090562:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788813146.090576:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813146.090773:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64342a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875706313298816:192.168.202.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788813146.091160:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813146.114073:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64342a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875706313298816:192.168.202.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788813146.115742:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813146.117311:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301691136 00000100:00100000:3.0:1788813146.117336:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301691136 00000100:00100000:3.0:1788813146.117472:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 78 00000100:00100000:3.0:1788813146.117486:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11276:x1875706301691136:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788813146.117735:0:6495:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788813146.118066:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11276:x1875706301691136:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 Request processed in 581us (2333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813146.118077:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 78 00000100:00100000:2.0:1788813146.160202:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813146.161589:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301691264 00000100:00100000:1.0:1788813146.161604:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301691264 00000100:00100000:1.0:1788813146.161684:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 79 00000100:00100000:1.0:1788813146.161696:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11276:x1875706301691264:12345-192.168.202.13@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788813146.161799:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff702fc8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.161822:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff702fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.161856:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff702fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163440:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff702fcf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163464:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff702fcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163476:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff702fcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163522:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff702fd6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163587:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff702fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163596:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff702fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813146.163646:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788813146.163651:0:9156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788813146.163668:0:9156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff702fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163681:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff702fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163688:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff702fc8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163710:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff702fc8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163717:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dacc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813146.163721:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff702fc8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163729:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff702fc8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163741:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6fe40300) 00010000:00010000:1.0:1788813146.163744:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813146.163748:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff702fc8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163755:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff702fc8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163769:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff702fcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163775:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff702fcf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.163781:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff702fcf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.164062:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dace00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813146.164066:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff702fcf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.164082:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff702fcf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.164091:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff948a455ee000) 00010000:00010000:1.0:1788813146.164094:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813146.164097:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff702fcf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.164114:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff702fcf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.164130:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff702fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.164137:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff702fd6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.164143:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff702fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.164147:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813146.164150:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff702fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.164156:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff702fd6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.164163:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813146.164165:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813146.164168:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff702fd6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.164182:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff702fd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813146.164345:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11276:x1875706301691264:12345-192.168.202.13@tcp:34:lhsmtool_posix.0 Request processed in 2647us (4153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813146.164356:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 79 00000100:00100000:0.0:1788813146.179115:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813146.179228:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301691520 00000100:00100000:1.0:1788813146.179242:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301691520 00000100:00100000:0.0:1788813146.179387:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 80 00000100:00100000:0.0:1788813146.179400:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11276:x1875706301691520:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813146.179610:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813146.179904:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff702fdd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729776 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.180096:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fe4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.181391:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.181497:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813146.181523:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788813146.181842:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.181854:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fe4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.181863:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.181879:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166fc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813146.181885:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.181895:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.181918:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813146.181922:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813146.181929:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fe4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.182036:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff702fe4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.182122:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff702fdd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729776 expref: 34 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.182137:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6fe40300) 00010000:00010000:3.0:1788813146.182140:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813146.182145:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff702fdd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729776 expref: 34 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.182158:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f000, rc 0) 00000100:00100000:3.0:1788813146.182258:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+33:11276:x1875706301691520:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 2860us (3168us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1788813146.182268:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 80 00000100:00100000:3.0:1788813146.187181:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813146.187426:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301691648 00000100:00100000:0.0:1788813146.187439:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301691648 00000100:00100000:0.0:1788813146.187510:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 81 00000100:00100000:0.0:1788813146.187521:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+33:11276:x1875706301691648:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788813146.187566:0:6495:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788813146.187720:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+33:11276:x1875706301691648:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 Request processed in 200us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813146.187729:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 81 00000100:00100000:0.0:1788813146.192253:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813146.192956:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301691904 00000100:00100000:3.0:1788813146.192971:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301691904 00000100:00100000:3.0:1788813146.193040:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 82 00000100:00100000:3.0:1788813146.193050:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+33:11276:x1875706301691904:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813146.193086:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813146.193090:0:9156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788813146.193152:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff702f9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729768 expref: 33 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.193173:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:3.0:1788813146.193189:0:9156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813146.193205:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff702ff2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072977d expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788813146.194828:0:9156:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788813146.195075:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702ff9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.195095:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.195117:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.195192:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff702ff2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072977d expref: 35 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.195209:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072977d expref: 34 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.195231:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948a764bea00) 00010000:00010000:3.0:1788813146.195234:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813146.195237:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656c00, rc 0) 00000100:00100000:3.0:1788813146.195322:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+34:11276:x1875706301691904:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 2272us (3082us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788813146.195330:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 82 00000100:00100000:1.0:1788813146.224367:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813146.224519:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301692160 00000100:00100000:0.0:1788813146.224534:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301692160 00000100:00100000:0.0:1788813146.224631:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 83 00000100:00100000:0.0:1788813146.224645:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+34:11276:x1875706301692160:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788813146.224735:0:12571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813146.224772:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff702ff9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072977d expref: 34 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.224805:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948a764bea00) 00010000:00010000:0.0:1788813146.224819:0:12571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813146.224854:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703007 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.224872:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703007 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.224886:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703007 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.224914:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70300e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x866c2674 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.224921:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70300e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x866c2674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.224929:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70300e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x866c2674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.225016:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703007 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.225036:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703007 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.225045:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703007 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.225067:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166ec00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813146.225073:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703007 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.225082:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703007 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.225092:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:0.0:1788813146.225095:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813146.225107:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703007 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.225114:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703007 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.225127:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70300e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x866c2674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.225132:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70300e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x866c2674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.225138:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70300e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x866c2674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.225143:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813146.225145:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70300e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x866c2674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.225151:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70300e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x866c2674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.225170:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x866c2674 (ffff948a74a15200) 00010000:00010000:0.0:1788813146.225172:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813146.225175:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70300e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x866c2674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.225181:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70300e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x866c2674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813146.225288:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+33:11276:x1875706301692160:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 647us (935us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813146.225296:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 83 00000100:00100000:0.0:1788813146.235466:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813146.242307:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301692288 00000100:00100000:2.0:1788813146.242330:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301692288 00000100:00100000:2.0:1788813146.242429:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 84 00000100:00100000:2.0:1788813146.242442:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+33:11276:x1875706301692288:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813146.242470:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813146.242505:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703015 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729784 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813146.242551:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70301c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813146.242568:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70301c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813146.242582:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70301c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813146.242736:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703015 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729784 expref: 35 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813146.242769:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70301c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729784 expref: 34 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813146.242778:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948943001300) 00010000:00010000:2.0:1788813146.242782:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788813146.242786:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08200, rc 0) 00000100:00100000:2.0:1788813146.242883:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+34:11276:x1875706301692288:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 443us (7427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813146.242897:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 84 00000100:00100000:2.0:1788813146.255172:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813146.256154:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301692544 00000100:00100000:3.0:1788813146.256171:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301692544 00000100:00100000:3.0:1788813146.256253:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 85 00000100:00100000:3.0:1788813146.256265:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+34:11276:x1875706301692544:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788813146.256392:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703023 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.256414:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.256429:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813146.256677:0:9156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788813146.256688:0:9156:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 299275755337ns, next at 300275752250ns, rc = 0 00000004:00010000:3.0:1788813146.256752:0:9156:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f46cc00 reply state 00000000080d83f0 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.256768:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703023 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.256777:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948943001300) 00010000:00010000:3.0:1788813146.256808:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788813146.256816:0:9156:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813146.256993:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+36:11276:x1875706301692544:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 729us (1836us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788813146.257001:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 85 00000100:00100000:2.0:1788813146.261158:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813146.261359:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301692672 00000100:00100000:0.0:1788813146.261386:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301692672 00000100:00100000:0.0:1788813146.261468:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 86 00000100:00100000:0.0:1788813146.261481:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+36:11276:x1875706301692672:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813146.261515:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813146.261543:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff70302a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072978b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.261628:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff70302a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072978b expref: 37 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.261646:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff70302a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072978b expref: 37 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.261670:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948943001300) 00010000:00010000:0.0:1788813146.261691:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813146.261697:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166ec00, rc 0) 00000100:00100000:0.0:1788813146.261777:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+37:11276:x1875706301692672:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 299us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813146.261784:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 86 00000100:00100000:0.0:1788813146.266406:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813146.266547:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301692800 00000100:00100000:2.0:1788813146.266560:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301692800 00000100:00100000:2.0:1788813146.266616:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 33 00000100:00100000:2.0:1788813146.266633:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1875706301692800:12345-192.168.202.13@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788813146.266678:0:8405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:2.0:1788813146.266720:0:8405:0:(genops.c:1384:class_connect()) connect: client d2fa4f95-78d4-4e44-8582-bb12ec2edfd4, cookie 0xf32533d6ff703031 00002000:00100000:2.0:1788813146.266734:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d2fa4f95-78d4-4e44-8582-bb12ec2edfd4/ffff9489437d9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788813146.266747:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788813146.266858:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788813146.266894:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9489437d8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813146.267007:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2395:x1875706301692800:12345-192.168.202.13@tcp:8:lhsmtool_posix.0 Request processed in 374us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813146.267015:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 33 00000100:00100000:3.0:1788813146.272254:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813146.274917:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301692928 00000100:00100000:0.0:1788813146.274961:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301692928 00000100:00100000:0.0:1788813146.275080:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 34 00000100:00100000:0.0:1788813146.275096:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:0:x1875706301692928:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788813146.279281:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788813146.290559:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1788813146.290581:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000100:00100000:1.0:1788813146.291420:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:0:x1875706301692928:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 Request processed in 16318us (19362us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788813146.291435:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 34 00000100:00100000:2.0:1788813146.314592:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813146.314710:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301693184 00000100:00100000:3.0:1788813146.314725:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301693184 00000100:00100000:3.0:1788813146.314987:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00100000:3.0:1788813146.315003:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+37:11276:x1875706301693184:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788813146.315338:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:11276:x1875706301693184:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 339us (759us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788813146.324962:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00100000:2.0:1788813146.325632:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813146.327303:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301693440 00000100:00100000:1.0:1788813146.327320:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301693440 00000100:00100000:1.0:1788813146.327480:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 87 00000100:00100000:1.0:1788813146.327494:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:11276:x1875706301693440:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788813146.327661:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:11276:x1875706301693440:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 170us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813146.327669:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 87 00000100:00100000:0.0:1788813146.334042:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813146.335441:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301693568 00000100:00100000:3.0:1788813146.335458:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301693568 00000100:00100000:3.0:1788813146.335541:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 88 00000100:00100000:3.0:1788813146.335554:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:11276:x1875706301693568:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813146.335582:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813146.335609:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703038 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729792 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.335695:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70303f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.335711:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70303f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.335724:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70303f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813146.335813:0:12571:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813146.335840:0:12571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70303f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.335874:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703038 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729792 expref: 40 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.335895:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70303f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729792 expref: 39 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.335905:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948943001300) 00010000:00010000:3.0:1788813146.335908:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788813146.335913:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657a00, rc 0) 00000100:00100000:3.0:1788813146.336056:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+39:11276:x1875706301693568:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 503us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813146.336070:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 88 00000100:00100000:3.0:1788813146.354767:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813146.354909:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301693696 00000100:00100000:1.0:1788813146.354923:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301693696 00000100:00100000:1.0:1788813146.355040:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 35 00000100:00100000:1.0:1788813146.355054:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301693696:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813146.355104:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813146.355133:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c7dd563/0xf32533d6ff703046 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729799 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813146.355193:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f1f5a, blocks: 0x0 00010000:00010000:1.0:1788813146.355221:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=299s v=(0 0) 00010000:00010000:1.0:1788813146.355227:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813146.355238:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c7dd563/0xf32533d6ff703046 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729799 expref: 6 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.355263:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c7dd563/0xf32533d6ff703046 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729799 expref: 6 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.355280:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dacc00, rc 0) 00000100:00100000:1.0:1788813146.355357:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2396:x1875706301693696:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 305us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813146.355365:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 35 00000100:00100000:3.0:1788813146.368248:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813146.368515:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301693952 00000100:00100000:1.0:1788813146.368529:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301693952 00000100:00100000:1.0:1788813146.368606:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 89 00000100:00100000:1.0:1788813146.368619:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+39:11276:x1875706301693952:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788813146.368758:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+39:11276:x1875706301693952:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 142us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813146.368767:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 89 00000100:00100000:0.0:1788813146.387082:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813146.387273:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301694080 00000100:00100000:3.0:1788813146.387288:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301694080 00000100:00100000:3.0:1788813146.387361:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 36 00000100:00100000:3.0:1788813146.387382:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:11276:x1875706301694080:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813146.387408:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813146.387432:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff70304d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07297a0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.387473:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c7dd563/0xf32533d6ff703046 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729799 expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.387500:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813146.387505:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813146.387511:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff70304d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297a0 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.387558:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c7dd563/0xf32533d6ff703046 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729799 expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.387575:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c7dd563/0xf32533d6ff703046 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729799 expref: 7 pid: 8405 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813146.387592:0:8403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8403:1875706313298944:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813146.387719:0:8403:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b5d43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813146.396296:0:8403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943531500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8403:1875706313298944:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813146.396344:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff70304d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297a0 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.396371:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656800, rc 0) 00000100:00100000:0.0:1788813146.396464:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:11276:x1875706301694080:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 9091us (9407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813146.396474:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 36 00000100:00100000:2.0:1788813146.405583:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813146.412013:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301694208 00000100:00100000:3.0:1788813146.412046:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301694208 00010000:00010000:3.0:1788813146.412137:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c7dd563/0xf32533d6ff703046 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729799 expref: 7 pid: 8405 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813146.412191:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 59 00000100:00100000:3.0:1788813146.412204:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2397:x1875706301694208:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813146.412224:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813146.412254:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c7dd563/0xf32533d6ff703046 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729799 expref: 7 pid: 8405 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.412292:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c7dd563/0xf32533d6ff703046 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729799 expref: 7 pid: 8405 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.412322:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c7dd563/0xf32533d6ff703046 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729799 expref: 7 pid: 8405 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.412344:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813146.412349:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813146.412359:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff70304d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297a0 expref: 6 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.412371:0:9502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff70304d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297a0 expref: 6 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.412420:0:9502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff70304d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297a0 expref: 6 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813146.412438:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943531180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9502:1875706313299072:192.168.202.13@tcp:105: 00000100:00100000:3.0:1788813146.412568:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b5d4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813146.420778:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813146.420963:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943531180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9502:1875706313299072:192.168.202.13@tcp:105: 00010000:00010000:3.0:1788813146.420994:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813146.421054:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301694208:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 8852us (15484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813146.421073:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 59 00000100:00100000:1.0:1788813146.423440:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301694336 00000100:00100000:1.0:1788813146.423458:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301694336 00002000:00100000:1.0:1788813146.423521:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff948a6a89f480 x1875706301694336/t0(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:717/0 lens 504/0 e 0 to 0 dl 1788813157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788813146.423554:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948a6a89f480 with x1875706301694336 ext(0->8) 00002000:00010000:1.0:1788813146.423561:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948a6a89f480 00000100:00100000:1.0:1788813146.423598:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:1.0:1788813146.423609:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301694336:12345-192.168.202.13@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788813146.439873:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2397:x1875706301694336:12345-192.168.202.13@tcp:4:lhsmtool_posix.0 Request processed in 16247us (19093us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788813146.439894:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 0 00002000:00100000:0.0:1788813146.439911:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff948a6a89f480 x1875706301694336/t4294967303(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:717/0 lens 504/448 e 0 to 0 dl 1788813157 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813146.439988:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948a6a89f480 with x1875706301694336 ext(0->8) 00002000:00010000:0.0:1788813146.439996:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948a6a89f480 00000100:00100000:0.0:1788813146.452925:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813146.453369:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301694464 00000100:00100000:3.0:1788813146.453390:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301694464 00000100:00100000:3.0:1788813146.453458:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 90 00000100:00100000:3.0:1788813146.453468:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+39:11276:x1875706301694464:12345-192.168.202.13@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788813146.463748:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1788813146.463773:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:3.0:1788813146.463982:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702eb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.463998:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702eb7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464008:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702eb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464015:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813146.464022:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702eb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464044:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702eb7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464080:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813146.464084:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813146.464090:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702eb7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464109:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff702eb7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464135:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702eda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464142:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702eda lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464171:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702eda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464177:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdbc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813146.464180:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702eda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464187:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702eda lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464196:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813146.464198:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813146.464201:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702eda lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464207:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff702eda lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464222:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702f20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464229:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702f20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464236:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702f20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464241:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813146.464243:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702f20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464259:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702f20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464269:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813146.464272:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813146.464275:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702f20 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464281:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff702f20 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464295:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703023 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464302:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703023 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464308:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703023 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464314:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813146.464317:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703023 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464323:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703023 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464331:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948943001300) 00010000:00010000:3.0:1788813146.464334:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788813146.464337:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703023 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.464353:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703023 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788813146.464762:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788813146.465364:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788813146.465384:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788813146.465591:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:11276:x1875706301694464:12345-192.168.202.13@tcp:44:lhsmtool_posix.0 Request processed in 12116us (12671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813146.465602:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 90 00000100:00100000:1.0:1788813146.469196:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813146.469286:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813146.469310:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313299200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788813146.469330:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301694592 00000100:00100000:3.0:1788813146.469344:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301694592 00000100:00100000:0.0:1788813146.469382:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813146.469468:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313299200 00000100:00100000:1.0:1788813146.469474:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313299200 00000100:00100000:1.0:1788813146.469536:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788813146.469549:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313299200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788813146.469738:0:10066:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788813146.469742:0:10066:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788813147 00002000:00010000:1.0:1788813146.469745:0:10066:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788813146.469747:0:10066:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788813146 -> 1788813147 00002000:00010000:1.0:1788813146.469749:0:10066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788813146.469824:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313299200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 277us (442us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788813146.469833:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1788813146.470119:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948943420380/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788813146.470127:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313299200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788813146.470366:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 38 00000100:00100000:3.0:1788813146.470384:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2397:x1875706301694592:12345-192.168.202.13@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788813146.472418:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788813146.472432:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788813146.472988:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301694592:12345-192.168.202.13@tcp:16:lhsmtool_posix.0 Request processed in 2606us (3800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813146.473001:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 38 00000100:00100000:3.0:1788813146.475901:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813146.475965:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301694848 00000100:00100000:3.0:1788813146.475978:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301694848 00000100:00100000:3.0:1788813146.476165:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 91 00000100:00100000:3.0:1788813146.476179:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:11276:x1875706301694848:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788813146.476250:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813146.476285:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70303f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729792 expref: 14 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.476306:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948943001300) 00010000:00010000:3.0:1788813146.476311:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813146.476349:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703054 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.476749:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.476764:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813146.477353:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059ca8759 reply state 000000003848d308 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.477369:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703054 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.477388:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948943001300) 00010000:00010000:3.0:1788813146.477391:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788813146.477395:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813146.477529:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:11276:x1875706301694848:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 1352us (1639us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788813146.477538:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 91 00000100:00100000:2.0:1788813146.484917:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813146.485012:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301694976 00000100:00100000:0.0:1788813146.485029:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301694976 00000100:00100000:0.0:1788813146.486680:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 39 00000100:00100000:0.0:1788813146.486700:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2396:x1875706301694976:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788813146.486923:0:10066:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788813146.486927:0:10066:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788813147 -> 1788813145 00002000:00010000:0.0:1788813146.486947:0:10066:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788813143 00002000:00010000:0.0:1788813146.486950:0:10066:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788813147 -> 1788813145 00002000:00010000:0.0:1788813146.486952:0:10066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788813146.487057:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301694976:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 Request processed in 365us (2149us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788813146.491183:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 39 00000100:00100000:1.0:1788813146.491971:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813146.492051:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301695232 00000100:00100000:2.0:1788813146.492136:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301695232 00000100:00100000:2.0:1788813146.492204:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 92 00000100:00100000:2.0:1788813146.492216:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:11276:x1875706301695232:12345-192.168.202.13@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788813146.492306:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70305b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813146.492326:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70301c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729784 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813146.492337:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70305b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813146.493620:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70301c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729784 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813146.493642:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70301c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729784 expref: 15 pid: 6496 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813146.493661:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a89ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1875706313299328:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813146.493790:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813146.503075:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813146.503471:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a89ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1875706313299328:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813146.503523:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70305b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813146.506280:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301695360 00000100:00100000:1.0:1788813146.506302:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301695360 00010000:00010000:1.0:1788813146.506359:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70301c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729784 expref: 16 pid: 6496 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813146.506409:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 60 00000100:00100000:1.0:1788813146.506423:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:2396:x1875706301695360:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813146.506441:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813146.506448:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70301c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729784 expref: 16 pid: 6496 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.506463:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70301c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729784 expref: 16 pid: 6496 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.506492:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70301c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729784 expref: 16 pid: 6496 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.506511:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948943001300) 00010000:00010000:1.0:1788813146.506517:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70305b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.506529:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70305b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.506538:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70305b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.506582:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813146.506657:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:2396:x1875706301695360:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 236us (3604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813146.506676:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 60 00010000:00010000:3.0:1788813146.508155:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70305b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.508169:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70305b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.508217:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70305b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.508224:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70305b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.508248:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70305b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.508256:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813146.508261:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70305b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.508271:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70305b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.508283:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948943001300) 00010000:00010000:3.0:1788813146.508287:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788813146.508292:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70305b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.508299:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70305b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813146.508390:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:11276:x1875706301695232:12345-192.168.202.13@tcp:55:lhsmtool_posix.0 Request processed in 16175us (16418us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788813146.508400:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 92 00000100:00100000:1.0:1788813146.526756:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813146.527325:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301695488 00000100:00100000:3.0:1788813146.527338:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301695488 00000100:00100000:3.0:1788813146.527418:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 40 00000100:00100000:3.0:1788813146.527431:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2398:x1875706301695488:12345-192.168.202.13@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788813146.527492:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ccf1a667/0xf32533d6ff703062 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.527519:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff70304d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297a0 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.527547:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813146.527554:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813146.527559:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf1a667/0xf32533d6ff703062 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.527608:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff70304d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297a0 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.527627:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff70304d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297a0 expref: 7 pid: 8403 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813146.527647:0:8403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8403:1875706313299456:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813146.527765:0:8403:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b5d4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813146.531536:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813146.531608:0:8403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943533b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8403:1875706313299456:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813146.531643:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ccf1a667/0xf32533d6ff703062 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813146.531682:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301695616 00000100:00100000:3.0:1788813146.531690:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301695616 00010000:00010000:3.0:1788813146.531732:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff70304d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297a0 expref: 8 pid: 8403 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813146.531770:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 61 00000100:00100000:3.0:1788813146.531810:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2396:x1875706301695616:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813146.531829:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813146.531858:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff70304d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297a0 expref: 8 pid: 8403 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.531873:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff70304d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297a0 expref: 8 pid: 8403 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.531900:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffebe236/0xf32533d6ff70304d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297a0 expref: 8 pid: 8403 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.531920:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813146.531925:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813146.531953:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccf1a667/0xf32533d6ff703062 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.531964:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf1a667/0xf32533d6ff703062 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.531990:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813146.532066:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301695616:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 262us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813146.532073:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 61 00010000:00010000:3.0:1788813146.532106:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ccf1a667/0xf32533d6ff703062 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.532115:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccf1a667/0xf32533d6ff703062 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.532141:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ccf1a667/0xf32533d6ff703062 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.532149:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf1a667/0xf32533d6ff703062 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.532157:0:8403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccf1a667/0xf32533d6ff703062 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.532163:0:8403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657a00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813146.532168:0:8403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf1a667/0xf32533d6ff703062 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.532178:0:8403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf1a667/0xf32533d6ff703062 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.532191:0:8403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccf1a667/0xf32533d6ff703062 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.532199:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccf1a667/0xf32533d6ff703062 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813146.532249:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2398:x1875706301695488:12345-192.168.202.13@tcp:1:lhsmtool_posix.0 Request processed in 4822us (5505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813146.532257:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 40 00000100:00100000:3.0:1788813146.536919:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813146.537265:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301695872 00000100:00100000:0.0:1788813146.537279:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301695872 00000100:00100000:0.0:1788813146.537353:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 93 00000100:00100000:0.0:1788813146.537366:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:11276:x1875706301695872:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788813146.537499:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703069 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.537522:0:9156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702ea9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729729 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.537533:0:9156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703069 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.537579:0:9156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729729 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.537597:0:9156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702ea9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729729 expref: 14 pid: 6495 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813146.537613:0:9156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943422300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9156:1875706313299584:192.168.202.13@tcp:104: 00000100:00100000:0.0:1788813146.537727:0:9156:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45b7a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813146.543320:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813146.543459:0:9156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943422300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9156:1875706313299584:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813146.543505:0:9156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703069 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813146.543629:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301696000 00000100:00100000:3.0:1788813146.543638:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301696000 00010000:00010000:3.0:1788813146.543688:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702ea9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729729 expref: 15 pid: 6495 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813146.543732:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 62 00000100:00100000:3.0:1788813146.543741:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50684450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:2397:x1875706301696000:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813146.543760:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813146.543768:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702ea9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729729 expref: 15 pid: 6495 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.543780:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729729 expref: 15 pid: 6495 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.543809:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff702ea9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729729 expref: 15 pid: 6495 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.543829:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813146.543835:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703069 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.543847:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703069 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.543856:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703069 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.543890:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813146.544008:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50684450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:2397:x1875706301696000:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 267us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813146.544016:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 62 00010000:00010000:0.0:1788813146.544191:0:9156:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703069 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.544200:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703069 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.544442:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703070 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.544468:0:9156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff70302a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072978b expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.544476:0:9156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703070 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.544514:0:9156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff70302a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072978b expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.544530:0:9156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff70302a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072978b expref: 14 pid: 6495 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813146.544545:0:9156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943422300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9156:1875706313299712:192.168.202.13@tcp:104: 00000100:00100000:0.0:1788813146.544604:0:9156:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45b7a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788813146.551238:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813146.551382:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301696128 00000100:00100000:3.0:1788813146.551396:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301696128 00010000:00010000:3.0:1788813146.551453:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff70302a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072978b expref: 15 pid: 6495 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813146.551502:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:3.0:1788813146.551514:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:2399:x1875706301696128:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813146.551533:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813146.551541:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff70302a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072978b expref: 15 pid: 6495 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.551556:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff70302a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072978b expref: 15 pid: 6495 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.551586:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948943001300) 00010000:00010000:3.0:1788813146.551593:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703070 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.551605:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703070 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.551614:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703070 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.551638:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813146.551712:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:2399:x1875706301696128:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 200us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813146.551740:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 63 00010000:00010000:0.0:1788813146.552692:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff70302a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072978b expref: 14 pid: 6495 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813146.552721:0:9156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943422300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9156:1875706313299712:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813146.552762:0:9156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703070 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.552774:0:9156:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703070 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813146.552780:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703070 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813146.553047:0:9156:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1788813146.553223:0:9156:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1788813146.553265:0:9156:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1788813146.558498:0:9156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943422300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9156:1875706313299840:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788813146.558602:0:9156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813146.558691:0:9156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813146.558746:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313299840 00000100:00100000:2.0:1788813146.558758:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313299840 00000100:00100000:2.0:1788813146.558912:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788813146.558923:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9156:x1875706313299840:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788813146.559391:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9156:x1875706313299840:12345-0@lo:1000:mdt00_003.0 Request processed in 469us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813146.559400:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788813146.559544:0:9156:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788813146.559550:0:9156:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff948943420380, transno 4294967304 00000100:00100000:3.0:1788813146.559601:0:9156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943422300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9156:1875706313299840:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788813146.559810:0:9156:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1788813146.559895:0:9156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943532a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9156:1875706313299968:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788813146.559927:0:9156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813146.559975:0:9156:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942dab900 going to sleep for 11 seconds 00000100:00100000:1.0:1788813146.560051:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313299968 00000100:00100000:1.0:1788813146.560063:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313299968 00000100:00100000:1.0:1788813146.560110:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788813146.560117:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9156:x1875706313299968:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788813146.560229:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9156:x1875706313299968:12345-0@lo:1000:mdt00_003.0 Request processed in 113us (302us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788813146.560236:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788813146.560268:0:9156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943532a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9156:1875706313299968:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788813146.560311:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703070 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560323:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703070 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560331:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703070 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560338:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813146.560343:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703070 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560352:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703070 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560401:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948943001300) 00010000:00010000:1.0:1788813146.560404:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813146.560411:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703070 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560419:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703070 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560453:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702fa5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560460:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702fa5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560466:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702fa5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560470:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813146.560473:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702fa5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560478:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702fa5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560485:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813146.560487:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813146.560490:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702fa5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560495:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff702fa5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560553:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703077 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560571:0:9156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff702fc1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072976f expref: 17 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560581:0:9156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703077 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560608:0:9156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff702fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072976f expref: 17 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.560621:0:9156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff702fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072976f expref: 17 pid: 12571 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813146.560633:0:9156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943498a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9156:1875706313300096:192.168.202.13@tcp:104: 00000100:00100000:1.0:1788813146.560701:0:9156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813146.565591:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813146.565983:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301696256 00000100:00100000:3.0:1788813146.565997:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301696256 00010000:00010000:3.0:1788813146.566069:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff702fc1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072976f expref: 18 pid: 12571 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813146.566261:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 64 00000100:00100000:3.0:1788813146.566273:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:2396:x1875706301696256:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813146.566294:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813146.566301:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff702fc1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072976f expref: 18 pid: 12571 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.566317:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff702fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072976f expref: 18 pid: 12571 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.566342:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813146.566348:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703077 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.566390:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703077 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.566399:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703077 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.566424:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813146.566503:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:2396:x1875706301696256:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 232us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813146.566512:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 64 00010000:00010000:1.0:1788813146.570298:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff702fc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072976f expref: 17 pid: 12571 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813146.571535:0:9156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943498a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9156:1875706313300096:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813146.571572:0:9156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703077 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571588:0:9156:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703077 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571595:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703077 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571636:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703077 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571644:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703077 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571652:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703077 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571659:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dadc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813146.571664:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703077 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571673:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703077 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571693:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813146.571697:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813146.571703:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703077 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571710:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703077 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571726:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703069 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571732:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703069 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571738:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703069 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571750:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813146.571754:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703069 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571761:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703069 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571771:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813146.571773:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788813146.571776:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703069 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813146.571782:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703069 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813146.573661:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:11276:x1875706301695872:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 36284us (36742us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788813146.573675:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 93 00000020:00080000:1.0:1788813146.573683:0:9156:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788813146.578453:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813146.578466:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813146.578494:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788813146.578502:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813146.586784:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813146.588810:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301696512 00000100:00100000:3.0:1788813146.588827:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301696512 00000100:00100000:3.0:1788813146.588897:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:3.0:1788813146.588908:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:11276:x1875706301696512:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788813146.589428:0:6497:0:(mdd_object.c:4199:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788813146.589462:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1788813146.589493:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70307e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.589510:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70307e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.589521:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70307e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.589530:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70307e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.589535:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70307e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.589556:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70307e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813146.589577:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788813146.589673:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:11276:x1875706301696512:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 765us (2897us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788813146.589682:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 20 00000020:00080000:3.0:1788813146.589687:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788813146.589752:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813146.589758:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70307e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813146.589765:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657a00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813146.589769:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70307e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813146.589777:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70307e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813146.589790:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948943001300) 00010000:00010000:2.0:1788813146.589799:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788813146.589805:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70307e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813146.589811:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70307e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813146.589822:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813146.589824:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813146.589826:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788813146.907204:0:14176:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788813146.907215:0:14176:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813146.907239:0:14176:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788813146.907246:0:14176:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788813147.036228:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813147.036304:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301696768 00000100:00100000:3.0:1788813147.036317:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301696768 00000100:00100000:3.0:1788813147.036400:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 94 00000100:00100000:3.0:1788813147.036419:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:11286:x1875706301696768:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813147.036447:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813147.036469:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703085 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07297a7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.036585:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656800/0xf32533d6ff70308c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.036601:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656800/0xf32533d6ff70308c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.036614:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656800/0xf32533d6ff70308c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813147.036647:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788813147.036773:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703085 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297a7 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.036791:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656800/0xf32533d6ff70308c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297a7 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.036799:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:3.0:1788813147.036802:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788813147.036806:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656800, rc 0) 00000100:00100000:3.0:1788813147.036869:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:11286:x1875706301696768:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 455us (651us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788813147.036876:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 94 00000100:00080000:0.0:1788813147.037080:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813147.042110:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813147.042148:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301696896 00000100:00100000:3.0:1788813147.042158:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301696896 00000100:00100000:3.0:1788813147.042210:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 95 00000100:00100000:3.0:1788813147.042221:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:11286:x1875706301696896:12345-192.168.202.13@tcp:34:lfs.0 00010000:00010000:3.0:1788813147.042299:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70309a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042317:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70309a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042332:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70309a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042349:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7030a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042366:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7030a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042374:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7030a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042465:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7030a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042473:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7030a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042480:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7030a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813147.042525:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7030a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042538:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70309a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042544:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70309a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042551:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70309a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042557:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813147.042561:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70309a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042567:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70309a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042587:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:3.0:1788813147.042590:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813147.042597:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70309a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042603:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70309a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042619:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7030a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042625:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7030a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042631:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7030a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042637:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813147.042640:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7030a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042646:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7030a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042653:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a764bed00) 00010000:00010000:3.0:1788813147.042656:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813147.042659:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7030a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042664:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7030a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042690:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7030a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042696:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7030a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042701:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7030a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042708:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813147.042711:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7030a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042716:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7030a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042723:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a764be500) 00010000:00010000:3.0:1788813147.042725:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813147.042728:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7030a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.042734:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7030a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813147.042824:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:11286:x1875706301696896:12345-192.168.202.13@tcp:34:lfs.0 Request processed in 603us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813147.042832:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 95 00000100:00100000:3.0:1788813147.069372:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813147.069436:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301697152 00000100:00100000:1.0:1788813147.069453:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301697152 00000100:00100000:1.0:1788813147.069527:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 96 00000100:00100000:1.0:1788813147.069539:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:11289:x1875706301697152:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813147.069559:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813147.069579:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff7030af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07297ae expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.069747:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7030b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.069770:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7030b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.069782:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7030b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.069796:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff7030bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.069802:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff7030bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.069808:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff7030bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.069921:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff7030c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070063:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff7030c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070074:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff7030c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813147.070085:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788813147.070172:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7030b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070181:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7030b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070187:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7030b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070200:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dada00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813147.070204:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7030b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070211:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7030b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070223:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:1.0:1788813147.070226:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813147.070231:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7030b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070237:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7030b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070252:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff7030bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070258:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff7030bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070264:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff7030bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070269:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813147.070273:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff7030bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070279:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff7030bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070296:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a584a3500) 00010000:00010000:1.0:1788813147.070299:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813147.070301:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff7030bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070307:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff7030bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070345:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff7030af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ae expref: 23 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070358:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff7030c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ae expref: 22 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.070365:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:1.0:1788813147.070367:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813147.070369:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dad400, rc 0) 00000100:00100000:1.0:1788813147.070443:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:11289:x1875706301697152:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 906us (1086us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788813147.070451:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 96 00000100:00100000:3.0:1788813147.073240:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813147.073303:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301697280 00000100:00100000:1.0:1788813147.073320:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301697280 00000100:00100000:1.0:1788813147.073392:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 97 00000100:00100000:1.0:1788813147.073407:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:11289:x1875706301697280:12345-192.168.202.13@tcp:54:lfs.0 00010000:00010000:1.0:1788813147.073480:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.073500:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.073524:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.073556:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.073563:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.073569:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.073574:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813147.073578:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.073584:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.073596:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:1.0:1788813147.073598:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813147.073603:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.073609:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813147.073685:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:11289:x1875706301697280:12345-192.168.202.13@tcp:54:lfs.0 Request processed in 282us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813147.073692:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 97 00000100:00100000:3.0:1788813147.078801:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813147.078977:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301697536 00000100:00100000:2.0:1788813147.078996:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301697536 00000100:00100000:2.0:1788813147.079068:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:2.0:1788813147.079083:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50e10c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:11289:x1875706301697536:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813147.079312:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50e10c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+23:11289:x1875706301697536:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 234us (528us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788813147.079319:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 21 00010000:00010000:2.0:1788813147.108334:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813147.113076:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813147.113152:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301697792 00000100:00100000:0.0:1788813147.113167:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301697792 00000100:00100000:0.0:1788813147.113247:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 98 00000100:00100000:0.0:1788813147.113259:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+23:10815:x1875706301697792:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813147.113292:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813147.113318:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff7030d9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07297b5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.113441:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.113458:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff7030c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ae expref: 24 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.113467:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.113504:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff7030c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ae expref: 24 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.113521:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff7030c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ae expref: 24 pid: 9156 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813147.113537:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943422680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313300224:192.168.202.13@tcp:104: 00000100:00100000:0.0:1788813147.113661:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943057d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813147.116249:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943422680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313300224:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813147.116281:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813147.118523:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813147.118626:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301697920 00000100:00100000:1.0:1788813147.118646:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301697920 00010000:00010000:1.0:1788813147.118688:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff7030c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ae expref: 25 pid: 9156 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813147.118721:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:1.0:1788813147.118729:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:2396:x1875706301697920:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813147.118743:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813147.118749:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff7030c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ae expref: 25 pid: 9156 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.118770:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff7030c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ae expref: 25 pid: 9156 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.118791:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff7030c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ae expref: 25 pid: 9156 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.118807:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:1.0:1788813147.118813:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.118823:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.118830:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.118851:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813147.118910:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:2396:x1875706301697920:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 180us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813147.119568:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 65 00010000:00010000:0.0:1788813147.120170:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.120180:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813147.120200:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788813147.120343:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff7030d9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297b5 expref: 25 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.120364:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297b5 expref: 24 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.120373:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:0.0:1788813147.120377:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788813147.120379:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166fc00, rc 0) 00000100:00100000:0.0:1788813147.120438:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:10815:x1875706301697792:12345-192.168.202.13@tcp:101:bash.0 Request processed in 7181us (7381us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1788813147.120446:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 98 00000100:00100000:2.0:1788813147.123467:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813147.123551:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301698048 00000100:00100000:1.0:1788813147.123561:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301698048 00000100:00100000:1.0:1788813147.123624:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 99 00000100:00100000:1.0:1788813147.123637:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:10815:x1875706301698048:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:1.0:1788813147.123665:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813147.123686:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07297bc expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.123721:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff7030f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.123735:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff7030f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.123747:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff7030f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.123873:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297bc expref: 26 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.123893:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff7030f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297bc expref: 25 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.123903:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:1.0:1788813147.123906:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788813147.123910:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac800, rc 0) 00000100:00100000:1.0:1788813147.124008:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:10815:x1875706301698048:12345-192.168.202.13@tcp:101:bash.0 Request processed in 373us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813147.124021:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 99 00000100:00100000:3.0:1788813147.134601:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813147.135327:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301698304 00000100:00100000:1.0:1788813147.135348:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301698304 00000100:00100000:1.0:1788813147.135460:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 100 00000100:00100000:1.0:1788813147.135472:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:10815:x1875706301698304:12345-192.168.202.13@tcp:36:bash.0 00010000:00010000:1.0:1788813147.135690:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.135707:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.135718:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788813147.135772:0:12571:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1788813147.135793:0:12571:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de4e8b15 reply state 00000000c4775f07 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.135804:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.135811:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:1.0:1788813147.135814:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788813147.135819:0:12571:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788813147.135895:0:12571:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1788813147.136032:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:10815:x1875706301698304:12345-192.168.202.13@tcp:36:bash.0 Request processed in 562us (1438us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788813147.136277:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 100 00000020:00080000:1.0:1788813147.136282:0:12571:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788813147.140012:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813147.140172:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301698432 00000100:00100000:0.0:1788813147.140183:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301698432 00000100:00100000:0.0:1788813147.140240:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 101 00000100:00100000:0.0:1788813147.140251:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:10815:x1875706301698432:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813147.140276:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813147.140309:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703103 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07297c3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.140367:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703103 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297c3 expref: 30 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.140381:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703103 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297c3 expref: 30 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.140400:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:0.0:1788813147.140403:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813147.140407:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166ec00, rc 0) 00000100:00100000:0.0:1788813147.140473:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:10815:x1875706301698432:12345-192.168.202.13@tcp:101:bash.0 Request processed in 224us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813147.140479:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 101 00000100:00100000:0.0:1788813147.147003:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813147.147751:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301698560 00000100:00100000:1.0:1788813147.147891:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301698560 00000100:00100000:1.0:1788813147.148023:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 41 00000100:00100000:1.0:1788813147.148044:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:10815:x1875706301698560:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:1.0:1788813147.148068:0:10066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813147.148101:0:10066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d38c805e/0xf32533d6ff70310a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07297ca expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813147.148124:0:10066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f1f59, atime: 0x6a9f1f57, ctime: 0x6a9f1f59, blocks: 0x8 00010000:00010000:1.0:1788813147.148149:0:10066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=300s v=(0 0) 00010000:00010000:1.0:1788813147.148154:0:10066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813147.148163:0:10066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d38c805e/0xf32533d6ff70310a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ca expref: 7 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.148181:0:10066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d38c805e/0xf32533d6ff70310a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ca expref: 7 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.148194:0:10066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dad400, rc 0) 00000100:00100000:1.0:1788813147.148249:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:10815:x1875706301698560:12345-192.168.202.13@tcp:101:bash.0 Request processed in 217us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813147.148256:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 41 00000100:00100000:2.0:1788813147.152514:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813147.152600:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301698688 00000100:00100000:0.0:1788813147.152611:0:8410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301698688 00002000:00010000:0.0:1788813147.152650:0:8410:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1788813147.152665:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948a7ccbc380 with x1875706301698688 ext(0->18446744073709551615) 00002000:00010000:0.0:1788813147.152677:0:8410:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948a7ccbc380. 00000100:00100000:0.0:1788813147.152708:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 1 00000100:00100000:0.0:1788813147.152718:0:8410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2397:x1875706301698688:12345-192.168.202.13@tcp:10:bash.0 00002000:00010000:0.0:1788813147.153022:0:8410:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788813147.153026:0:8410:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788813145 -> 1788813147 00002000:00010000:0.0:1788813147.153029:0:8410:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788813143 -> 1788813143 00002000:00010000:0.0:1788813147.153031:0:8410:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788813145 -> 1788813147 00002000:00010000:0.0:1788813147.153053:0:8410:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788813147.153126:0:8410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2397:x1875706301698688:12345-192.168.202.13@tcp:10:bash.0 Request processed in 409us (621us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788813147.153135:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 1 00002000:00010000:0.0:1788813147.153139:0:8410:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1788813147.153141:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948a7ccbc380 with x1875706301698688 ext(0->18446744073709551615) 00002000:00010000:0.0:1788813147.153145:0:8410:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948a7ccbc380. 00000100:00100000:2.0:1788813147.256427:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813147.256509:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301698816 00000100:00100000:1.0:1788813147.256517:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301698816 00000100:00100000:1.0:1788813147.256563:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 102 00000100:00100000:1.0:1788813147.256570:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:11303:x1875706301698816:12345-192.168.202.13@tcp:34:lfs.0 00010000:00010000:1.0:1788813147.256630:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff703111 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.256660:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff703111 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.256672:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff703111 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.256688:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703118 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.256695:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.256701:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.256783:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff70311f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.256791:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff70311f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.256799:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff70311f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813147.256850:0:9156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff70311f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.256861:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff703111 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.256867:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff703111 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.256884:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff703111 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.256891:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813147.256895:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff703111 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.256902:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff703111 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.256914:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:1.0:1788813147.256917:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813147.256922:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff703111 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.256928:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff703111 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.257184:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.257191:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703118 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.257196:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703118 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.257201:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dada00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813147.257204:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703118 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.257220:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703118 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.257228:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a584a3000) 00010000:00010000:1.0:1788813147.257231:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813147.257234:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703118 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.257240:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703118 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.257254:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff70311f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.257259:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff70311f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.257264:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff70311f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.257269:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dadc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813147.257272:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff70311f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.257278:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff70311f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.257285:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:1.0:1788813147.257287:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813147.257290:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff70311f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.257304:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff70311f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813147.257454:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:11303:x1875706301698816:12345-192.168.202.13@tcp:34:lfs.0 Request processed in 884us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813147.257460:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 102 00000100:00100000:2.0:1788813147.319894:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813147.322578:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301699072 00000100:00100000:0.0:1788813147.322594:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301699072 00000100:00100000:0.0:1788813147.322747:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 103 00000100:00100000:0.0:1788813147.322760:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:11306:x1875706301699072:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813147.322781:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813147.322803:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703126 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07297d1 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.322886:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70312d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.322901:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70312d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.322914:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70312d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.322956:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703134 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.322965:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.322992:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323138:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70313b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323148:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70313b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323155:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70313b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813147.323289:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788813147.323368:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70312d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323376:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70312d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323382:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70312d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323389:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813147.323393:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70312d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323400:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70312d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323412:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:0.0:1788813147.323416:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813147.323427:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70312d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323433:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70312d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323447:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323454:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703134 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323460:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703134 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323466:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813147.323469:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703134 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323475:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703134 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323483:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a74a15f00) 00010000:00010000:0.0:1788813147.323486:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813147.323489:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703134 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323496:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703134 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323533:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703126 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297d1 expref: 33 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323560:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70313b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297d1 expref: 32 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.323569:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:0.0:1788813147.323572:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788813147.323574:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f200, rc 0) 00000100:00100000:0.0:1788813147.323648:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11306:x1875706301699072:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 891us (3764us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788813147.323656:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 103 00000100:00100000:2.0:1788813147.328537:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813147.328634:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301699200 00000100:00100000:3.0:1788813147.328651:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301699200 00000100:00100000:3.0:1788813147.329113:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 104 00000100:00100000:3.0:1788813147.329129:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11306:x1875706301699200:12345-192.168.202.13@tcp:54:lfs.0 00010000:00010000:3.0:1788813147.329231:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703149 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.329254:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297b5 expref: 32 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.329266:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703149 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.329313:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297b5 expref: 32 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.329330:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297b5 expref: 32 pid: 6495 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813147.329347:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943698000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1875706313300352:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813147.329474:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942dab540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813147.338028:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813147.338065:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301699456 00000100:00100000:2.0:1788813147.338075:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301699456 00000100:00100000:2.0:1788813147.338146:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:2.0:1788813147.338166:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+33:10752:x1875706301699456:12345-192.168.202.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788813147.349481:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943698000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1875706313300352:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813147.349515:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703149 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813147.350295:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+34:10752:x1875706301699456:12345-192.168.202.13@tcp:35:ldlm_bl.0 Request processed in 12124us (12270us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788813147.350307:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:0.0:1788813147.353836:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813147.354151:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301699584 00000100:00100000:2.0:1788813147.354163:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301699584 00010000:00010000:2.0:1788813147.354209:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297b5 expref: 34 pid: 6495 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813147.354252:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 66 00000100:00100000:2.0:1788813147.354263:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+34:2396:x1875706301699584:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813147.354281:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813147.354290:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297b5 expref: 34 pid: 6495 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.354308:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297b5 expref: 34 pid: 6495 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.354334:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7030e0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297b5 expref: 34 pid: 6495 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.354354:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:2.0:1788813147.354360:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703149 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.354370:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.354808:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703149 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.354850:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813147.354927:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+33:2396:x1875706301699584:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 664us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813147.354994:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 66 00010000:00010000:1.0:1788813147.355081:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.355100:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.355145:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.355154:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703149 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.355162:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703149 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.355168:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813147.355174:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703149 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.355182:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703149 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.355203:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:1.0:1788813147.355207:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813147.355212:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703149 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.355218:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703149 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813147.355262:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11306:x1875706301699200:12345-192.168.202.13@tcp:54:lfs.0 Request processed in 26139us (26736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813147.355269:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 104 00000100:00100000:3.0:1788813147.359452:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813147.360740:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301699840 00000100:00100000:2.0:1788813147.360753:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301699840 00000100:00100000:2.0:1788813147.360819:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:2.0:1788813147.360830:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:11306:x1875706301699840:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813147.361105:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+33:11306:x1875706301699840:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 277us (1662us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788813147.361112:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:3.0:1788813147.426510:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813147.426661:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301700096 00000100:00100000:1.0:1788813147.426675:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301700096 00000100:00100000:1.0:1788813147.426759:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 105 00000100:00100000:1.0:1788813147.426771:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+33:11317:x1875706301700096:12345-192.168.202.13@tcp:101:cat.0 00010000:00010000:1.0:1788813147.426805:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813147.426834:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703150 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07297d8 expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427001:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703157 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427020:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703157 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427045:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703157 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427070:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70315e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427107:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70315e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427114:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70315e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427262:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff703165 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427273:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff703165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427280:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff703165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813147.427292:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788813147.427392:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703157 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427401:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703157 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427408:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703157 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427414:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dada00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813147.427419:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703157 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427427:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703157 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427452:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:1.0:1788813147.427456:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813147.427463:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703157 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427471:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703157 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427491:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70315e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427496:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70315e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427501:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70315e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427507:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813147.427510:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70315e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427516:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70315e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427523:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a584a3000) 00010000:00010000:1.0:1788813147.427526:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813147.427529:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70315e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427534:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70315e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427598:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dadc00/0xf32533d6ff703150 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297d8 expref: 36 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427613:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff703165 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297d8 expref: 35 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.427620:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:1.0:1788813147.427623:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813147.427625:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac400, rc 0) 00000100:00100000:1.0:1788813147.427713:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+35:11317:x1875706301700096:12345-192.168.202.13@tcp:101:cat.0 Request processed in 944us (1219us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788813147.427721:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 105 00000100:00100000:0.0:1788813147.434410:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813147.439654:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301700352 00000100:00100000:2.0:1788813147.439677:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301700352 00000100:00100000:2.0:1788813147.439778:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:2.0:1788813147.440014:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+35:11317:x1875706301700352:12345-192.168.202.13@tcp:35:cat.0 00000100:00100000:2.0:1788813147.440451:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+36:11317:x1875706301700352:12345-192.168.202.13@tcp:35:cat.0 Request processed in 661us (6054us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788813147.440460:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:2.0:1788813147.459262:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813147.459363:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301700608 00000100:00100000:0.0:1788813147.459378:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301700608 00000100:00100000:0.0:1788813147.459454:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 106 00000100:00100000:0.0:1788813147.459467:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+36:11318:x1875706301700608:12345-192.168.202.13@tcp:36:rm.0 00010000:00010000:0.0:1788813147.459551:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788813147.459589:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703103 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297c3 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.459621:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff703165 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297d8 expref: 35 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.459636:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70313b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297d1 expref: 34 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.459680:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff7030f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297bc expref: 33 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.459693:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:0.0:1788813147.459699:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813147.459730:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff703173 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.459747:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff703173 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.459760:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff703173 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.459780:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70317a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.459916:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70317a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.459925:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70317a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.460348:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703181 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.460358:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703181 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.460366:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703181 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813147.460660:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1788813147.460672:0:6495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 300479739081ns, next at 301479735803ns, rc = 0 00010000:00010000:0.0:1788813147.460729:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703188 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.460738:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703188 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.460747:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703188 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.460755:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703188 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.460762:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703188 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.460769:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703188 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.460813:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813147.460837:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703181 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.460843:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703181 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.460849:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703181 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.461333:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166fc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813147.461352:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703181 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.461363:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703181 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.461375:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:0.0:1788813147.461380:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788813147.461385:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703181 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.461393:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703181 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.461418:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff703173 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.461424:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff703173 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.461430:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff703173 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.461435:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813147.461438:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff703173 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.461444:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff703173 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.461452:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:0.0:1788813147.461455:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813147.461464:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff703173 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.461470:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5800/0xf32533d6ff703173 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813147.461482:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5e6e8a5 reply state 000000002babcaef transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70317a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.461493:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70317a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.461500:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a74a15f00) 00010000:00010000:0.0:1788813147.461502:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788813147.461504:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788813147.462978:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813147.462993:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703188 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.463036:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813147.463041:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703188 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.463194:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703188 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.463215:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:2.0:1788813147.463218:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788813147.463223:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703188 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.463229:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703188 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.463250:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813147.463252:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813147.463253:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813147.463420:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+34:11318:x1875706301700608:12345-192.168.202.13@tcp:36:rm.0 Request processed in 3946us (4165us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788813147.463432:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 106 00000100:00100000:2.0:1788813147.494837:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313300480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813147.494967:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813147.495432:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313300480 00000100:00100000:0.0:1788813147.495445:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313300480 00000100:00100000:0.0:1788813147.495527:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788813147.495541:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1875706313300480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813147.495581:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813147.495644:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3625:x1875706313300480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813147.495652:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1788813147.495772:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813147.495821:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313300480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813147.496069:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313300608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813147.496123:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813147.496314:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313300608 00000100:00100000:1.0:1788813147.496320:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313300608 00000100:00100000:1.0:1788813147.496370:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788813147.496378:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313300608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788813147.496392:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813147.496434:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313300608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813147.496441:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788813147.496475:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313300608:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788813147.496588:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813147.509982:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813147.510115:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301700864 00000100:00100000:1.0:1788813147.510130:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301700864 00000100:00100000:1.0:1788813147.510213:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 107 00000100:00100000:1.0:1788813147.510226:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+34:11324:x1875706301700864:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:1.0:1788813147.510282:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813147.510311:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70318f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07297df expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.510457:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703196 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.510477:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703196 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.510491:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703196 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.510503:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff70319d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.510510:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff70319d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.510515:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff70319d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788813147.510996:0:6494:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788813147.511180:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff7031a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.511190:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff7031a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.511198:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff7031a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.511253:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703196 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.511262:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703196 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.511269:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703196 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.511276:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dada00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813147.511281:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703196 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.511289:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703196 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.511303:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:1.0:1788813147.511306:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813147.511312:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703196 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.511319:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703196 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813147.511337:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1848ea6 reply state 000000000cfaf6d9 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff70319d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.511351:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff70319d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.511357:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a74a15f00) 00010000:00010000:1.0:1788813147.511365:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788813147.511369:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788813147.511409:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70318f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297df expref: 37 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.511427:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff7031a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297df expref: 36 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.511434:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a584a3000) 00010000:00010000:1.0:1788813147.511436:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813147.511439:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac200, rc 0) 00000100:00100000:1.0:1788813147.511534:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+37:11324:x1875706301700864:12345-192.168.202.13@tcp:101:bash.0 Request processed in 1309us (1613us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788813147.511542:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 107 00000100:00100000:1.0:1788813147.514907:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813147.515052:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301700992 00000100:00100000:3.0:1788813147.515102:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301700992 00000100:00100000:3.0:1788813147.515247:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 42 00000100:00100000:3.0:1788813147.515259:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301700992:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:3.0:1788813147.515286:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813147.515320:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07297e6 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813147.515356:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813147.515384:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=300s v=(0 0) 00010000:00010000:3.0:1788813147.515389:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813147.515401:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297e6 expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.515426:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297e6 expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.515443:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657200, rc 0) 00000100:00100000:3.0:1788813147.515533:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2396:x1875706301700992:12345-192.168.202.13@tcp:101:bash.0 Request processed in 276us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813147.515541:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 42 00000100:00080000:0.0:1788813147.516454:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813147.520851:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813147.521178:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301701120 00000100:00100000:0.0:1788813147.521210:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301701120 00000100:00100000:0.0:1788813147.521285:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 43 00000100:00100000:0.0:1788813147.521298:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:11324:x1875706301701120:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813147.521322:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813147.521346:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07297ed expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.521387:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297e6 expref: 9 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.521398:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813147.521404:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813147.521410:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 9 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.521453:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297e6 expref: 9 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.521470:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297e6 expref: 9 pid: 8403 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813147.521486:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943421880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8404:1875706313300736:192.168.202.13@tcp:104: 00000100:00100000:0.0:1788813147.521650:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943057c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813147.524413:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943421880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8404:1875706313300736:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813147.524461:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 9 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.524512:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166fc00, rc 0) 00000100:00100000:0.0:1788813147.524582:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:11324:x1875706301701120:12345-192.168.202.13@tcp:101:bash.0 Request processed in 3287us (3746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813147.524593:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 43 00000100:00100000:2.0:1788813147.527156:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813147.527271:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301701248 00000100:00100000:3.0:1788813147.527285:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301701248 00010000:00010000:3.0:1788813147.527342:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297e6 expref: 9 pid: 8403 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813147.527427:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:3.0:1788813147.527439:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2397:x1875706301701248:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813147.527481:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813147.527510:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297e6 expref: 9 pid: 8403 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.527526:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297e6 expref: 9 pid: 8403 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.527557:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297e6 expref: 9 pid: 8403 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.527581:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813147.527586:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813147.527594:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.527605:0:9502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.527659:0:9502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813147.527676:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9502:1875706313300864:192.168.202.13@tcp:105: 00000100:00100000:3.0:1788813147.527803:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942daba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813147.531570:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9502:1875706313300864:192.168.202.13@tcp:105: 00010000:00010000:3.0:1788813147.531606:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813147.531703:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2397:x1875706301701248:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 4265us (4559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813147.531718:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:0.0:1788813147.533772:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813147.533921:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301701504 00000100:00100000:2.0:1788813147.533959:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301701504 00000100:00100000:2.0:1788813147.534030:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:2.0:1788813147.534044:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+37:11324:x1875706301701504:12345-192.168.202.13@tcp:35:bash.0 00000100:00100000:2.0:1788813147.534468:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:11324:x1875706301701504:12345-192.168.202.13@tcp:35:bash.0 Request processed in 425us (707us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788813147.534476:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:2.0:1788813147.692432:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813147.692648:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301701632 00000100:00100000:3.0:1788813147.692663:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301701632 00000100:00100000:3.0:1788813147.692757:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 108 00000100:00100000:3.0:1788813147.692771:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:11340:x1875706301701632:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813147.693197:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813147.693230:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7031c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07297f4 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.693327:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7031c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.693344:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7031c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.693359:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7031c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813147.693415:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788813147.693419:0:12571:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813147.693445:0:12571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7031c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.693478:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7031c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297f4 expref: 40 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.693501:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7031c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297f4 expref: 39 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.693535:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:3.0:1788813147.693538:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813147.693542:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657a00, rc 0) 00000100:00100000:3.0:1788813147.694168:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+39:11340:x1875706301701632:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 1396us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813147.694179:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 108 00000100:00100000:0.0:1788813147.702265:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813147.702384:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301701888 00000100:00100000:3.0:1788813147.702398:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301701888 00000100:00100000:3.0:1788813147.702528:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 109 00000100:00100000:3.0:1788813147.702543:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+39:11340:x1875706301701888:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813147.702574:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813147.702602:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff7031ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07297fb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.702777:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff7031d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.703216:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff7031d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.703235:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff7031d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813147.703252:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788813147.703409:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff7031ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297fb expref: 42 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.703461:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff7031d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297fb expref: 41 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.703472:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a584a3000) 00010000:00010000:3.0:1788813147.703475:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813147.703480:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657400, rc 0) 00000100:00100000:3.0:1788813147.703560:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+41:11340:x1875706301701888:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 1022us (1312us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788813147.703569:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 109 00000100:00100000:2.0:1788813147.711643:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813147.711701:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813147.711865:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301702144 00000100:00100000:3.0:1788813147.711878:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301702144 00000100:00100000:3.0:1788813147.711964:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 110 00000100:00100000:3.0:1788813147.711977:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+41:11340:x1875706301702144:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813147.712009:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813147.712047:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7031e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729802 expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.712201:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff7031ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.712222:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff7031ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.712237:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff7031ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813147.712252:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788813147.712397:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7031e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729802 expref: 44 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.712419:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff7031ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729802 expref: 43 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.712427:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a584a3000) 00010000:00010000:3.0:1788813147.712431:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788813147.712436:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657800, rc 0) 00000100:00100000:3.0:1788813147.712514:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+43:11340:x1875706301702144:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 540us (885us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1788813147.712522:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 110 00000100:00100000:1.0:1788813147.713061:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301702272 00000100:00100000:1.0:1788813147.713070:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301702272 00000100:00100000:1.0:1788813147.713134:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:1.0:1788813147.713143:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+43:2396:x1875706301702272:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813147.713157:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813147.713174:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff7031d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297fb expref: 43 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.713189:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a584a3000) 00010000:00010000:1.0:1788813147.713193:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813147.713228:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+42:2396:x1875706301702272:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 86us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813147.713235:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:2.0:1788813147.723256:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813147.723381:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301702400 00000100:00100000:3.0:1788813147.723396:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301702400 00000100:00100000:3.0:1788813147.723528:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 44 00000100:00100000:3.0:1788813147.723542:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2399:x1875706301702400:12345-192.168.202.13@tcp:1:lfs.0 00010000:00010000:3.0:1788813147.723604:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.723631:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.723640:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813147.723646:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813147.723652:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031f8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.723701:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.723807:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 8 pid: 8404 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813147.723828:0:8403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8403:1875706313300992:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813147.723989:0:8403:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942dab000 going to sleep for 11 seconds 00000100:00100000:3.0:1788813147.733479:0:8403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8403:1875706313300992:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813147.733518:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813147.735557:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813147.735691:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301702528 00000100:00100000:0.0:1788813147.735704:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301702528 00002000:00100000:0.0:1788813147.735857:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff94894334f100 x1875706301702528/t0(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:718/0 lens 504/0 e 0 to 0 dl 1788813158 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813147.735869:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94894334f100 with x1875706301702528 ext(0->8) 00010000:00010000:0.0:1788813147.735882:0:8412:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 9 pid: 8404 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.735904:0:8412:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 9 pid: 8404 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813147.735913:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94894334f100 00000100:00100000:0.0:1788813147.736002:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 1 00000100:00100000:0.0:1788813147.736015:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2397:x1875706301702528:12345-192.168.202.13@tcp:4:lfs.0 00000100:00100000:0.0:1788813147.738332:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+11:2397:x1875706301702528:12345-192.168.202.13@tcp:4:lfs.0 Request processed in 2306us (2775us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788813147.738349:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 1 00002000:00100000:0.0:1788813147.738363:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff94894334f100 x1875706301702528/t4294967303(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:718/0 lens 504/448 e 0 to 0 dl 1788813158 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813147.738388:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94894334f100 with x1875706301702528 ext(0->8) 00010000:00010000:0.0:1788813147.738399:0:8412:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 11 pid: 8404 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.738422:0:8412:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 11 pid: 8404 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813147.738432:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94894334f100 00000100:00100000:1.0:1788813147.743012:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000001:00080000:0.0:1788813147.743136:0:8399:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1788813147.743152:0:8399:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1788813147.743248:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301702656 00000100:00100000:2.0:1788813147.743261:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301702656 00010000:00010000:2.0:1788813147.743315:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 7 pid: 8404 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813147.743368:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 68 00000100:00100000:2.0:1788813147.743379:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50685850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2398:x1875706301702656:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813147.743399:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788813147.743427:0:6480:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788813147.743430:0:6480:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788813148 00002000:00010000:2.0:1788813147.743433:0:6480:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788813148 00002000:00010000:2.0:1788813147.743435:0:6480:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788813148 00002000:00010000:2.0:1788813147.743437:0:6480:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788813147.743444:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 7 pid: 8404 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.743460:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 7 pid: 8404 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.743512:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b79c582e/0xf32533d6ff7031b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ed expref: 7 pid: 8404 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.743533:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813147.743538:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813147.743545:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.743557:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031f8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.743598:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813147.743670:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50685850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2398:x1875706301702656:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 293us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813147.743678:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 68 00010000:00010000:0.0:1788813147.744865:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.744883:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.744916:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.744926:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.744965:0:8403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.744974:0:8403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813147.744997:0:8403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.745008:0:8403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.745040:0:8403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813147.745049:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008b08979/0xf32533d6ff7031f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813147.745145:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301702400:12345-192.168.202.13@tcp:1:lfs.0 Request processed in 21605us (21903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813147.745155:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 44 00000100:00100000:1.0:1788813147.750102:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813147.750847:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301702912 00000100:00100000:2.0:1788813147.750861:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301702912 00000100:00100000:2.0:1788813147.750965:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 26 00000100:00100000:2.0:1788813147.750978:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a612cc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+42:11340:x1875706301702912:12345-192.168.202.13@tcp:35:lfs.0 00000004:00010000:2.0:1788813147.751076:0:6498:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff7031ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729802 expref: 42 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813147.751317:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788813147.751345:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788813147.753418:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788813147.753514:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7031ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.753558:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff7031a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297df expref: 46 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.753568:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7031ff lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.753619:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff7031a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297df expref: 46 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.753639:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff7031a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297df expref: 46 pid: 6494 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813147.753658:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1875706313301120:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813147.754965:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813147.760094:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1875706313301120:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813147.760145:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7031ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813147.771224:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813147.773331:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301703040 00000100:00100000:3.0:1788813147.773346:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301703040 00010000:00010000:3.0:1788813147.773396:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff7031a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297df expref: 47 pid: 6494 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813147.773444:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 69 00000100:00100000:3.0:1788813147.773454:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+47:2396:x1875706301703040:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813147.773469:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813147.773475:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff7031a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297df expref: 47 pid: 6494 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.773487:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff7031a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297df expref: 47 pid: 6494 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.773508:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff7031a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297df expref: 47 pid: 6494 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.773538:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a584a3000) 00010000:00010000:3.0:1788813147.773544:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7031ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.773553:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7031ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.773560:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7031ff lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.773736:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813147.773810:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+46:2396:x1875706301703040:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 357us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813147.773819:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 69 00010000:00010000:2.0:1788813147.781374:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7031ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.781395:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7031ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813147.781520:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1788813147.781640:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788813147.781797:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313301248:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788813147.781874:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813147.781966:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4540 going to sleep for 11 seconds 00000100:00100000:1.0:1788813147.782143:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313301248 00000100:00100000:1.0:1788813147.782153:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313301248 00000100:00100000:1.0:1788813147.782241:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788813147.782256:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6498:x1875706313301248:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788813147.782366:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6498:x1875706313301248:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 112us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813147.782374:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788813147.782448:0:6498:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1788813147.782454:0:6498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:2.0:1788813147.782473:0:6498:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94894365ad80, transno 4294967302 00000100:00100000:2.0:1788813147.782546:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313301248:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788813147.782671:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788813147.782869:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313301376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788813147.782901:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813147.784331:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788813147.784463:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313301376 00000100:00100000:3.0:1788813147.784473:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313301376 00000100:00100000:3.0:1788813147.784522:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788813147.784531:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6498:x1875706313301376:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788813147.784818:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6498:x1875706313301376:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 288us (1916us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788813147.784826:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788813147.785279:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313301376:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788813147.785339:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788813147.785560:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7031ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.785572:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7031ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.785580:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7031ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.785586:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813147.785591:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7031ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.785599:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7031ff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.785614:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a584a3000) 00010000:00010000:2.0:1788813147.785630:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788813147.785636:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7031ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.785642:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7031ff lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788813147.786016:0:6498:0:(mdd_object.c:4199:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788813147.786076:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788813147.786096:0:6498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 300805163556ns, next at 301805161055ns, rc = 0 00000001:00080000:2.0:1788813147.786103:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1788813147.786129:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a584a3000) 00010000:00010000:2.0:1788813147.786132:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788813147.786140:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff7031ea lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729802 expref: 50 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813147.786302:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a612cc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+49:11340:x1875706301702912:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 35327us (36222us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788813147.786312:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 26 00000020:00080000:2.0:1788813147.786317:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788813147.795577:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813147.795749:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301703168 00000100:00100000:3.0:1788813147.795762:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301703168 00000100:00100000:3.0:1788813147.795829:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 111 00000100:00100000:3.0:1788813147.795841:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+49:11340:x1875706301703168:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813147.795870:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813147.795907:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703206 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729809 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.796014:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703206 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729809 expref: 50 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.796031:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703206 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729809 expref: 50 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.796049:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813147.796053:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813147.796057:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656e00, rc 0) 00000100:00100000:3.0:1788813147.796125:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+50:11340:x1875706301703168:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 287us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813147.796133:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 111 00000100:00100000:1.0:1788813147.803612:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813147.804895:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301703424 00000100:00100000:3.0:1788813147.804910:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301703424 00000100:00100000:3.0:1788813147.806222:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 27 00000100:00100000:3.0:1788813147.806235:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+50:11340:x1875706301703424:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:3.0:1788813147.806456:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+51:11340:x1875706301703424:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 225us (2854us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788813147.808431:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 27 00000100:00100000:2.0:1788813147.936111:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813147.936235:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301703552 00000100:00100000:3.0:1788813147.936246:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301703552 00000100:00100000:3.0:1788813147.936311:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 112 00000100:00100000:3.0:1788813147.936321:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+51:11350:x1875706301703552:12345-192.168.202.13@tcp:34:lfs.0 00010000:00010000:3.0:1788813147.936405:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70320d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936441:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70320d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936456:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70320d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936469:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703214 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936476:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936483:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936563:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70321b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936571:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70321b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936578:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70321b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813147.936627:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70321b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936641:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70320d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936648:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70320d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936665:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70320d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936671:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813147.936675:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70320d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936683:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70320d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936708:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:3.0:1788813147.936712:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813147.936717:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70320d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936723:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70320d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936739:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936746:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703214 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936752:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703214 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936757:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813147.936760:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703214 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936778:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703214 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936786:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a74a15f00) 00010000:00010000:3.0:1788813147.936788:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813147.936791:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703214 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936797:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703214 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936806:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70321b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936811:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70321b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936817:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70321b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936822:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813147.936825:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70321b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936830:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70321b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936838:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813147.936840:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813147.936843:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70321b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813147.936859:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70321b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813147.937375:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+51:11350:x1875706301703552:12345-192.168.202.13@tcp:34:lfs.0 Request processed in 1051us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813147.937385:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 112 00000100:00100000:1.0:1788813147.971507:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813147.971619:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301703808 00000100:00100000:2.0:1788813147.971629:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301703808 00000100:00100000:2.0:1788813147.971707:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 113 00000100:00100000:2.0:1788813147.971719:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+51:11353:x1875706301703808:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813147.971768:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813147.971790:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703222 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729810 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.971886:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff703229 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.971902:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff703229 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.971914:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff703229 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.971926:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703230 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.971970:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.971977:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972111:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703237 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972120:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703237 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972128:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703237 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813147.972139:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788813147.972217:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff703229 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972226:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff703229 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972243:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff703229 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972250:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813147.972254:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff703229 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972263:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff703229 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972276:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:2.0:1788813147.972279:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813147.972286:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff703229 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972293:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff703229 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972309:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972316:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703230 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972322:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703230 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972326:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813147.972328:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703230 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972343:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703230 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972352:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a74a15f00) 00010000:00010000:2.0:1788813147.972354:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813147.972357:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703230 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972364:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703230 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972402:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703222 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729810 expref: 54 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972417:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703237 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729810 expref: 53 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813147.972424:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:2.0:1788813147.972426:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813147.972429:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08800, rc 0) 00000100:00100000:2.0:1788813147.972498:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+53:11353:x1875706301703808:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 780us (1002us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788813147.972506:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 113 00000100:00100000:3.0:1788813147.976407:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813147.976522:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301703936 00000100:00100000:1.0:1788813147.976532:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301703936 00000100:00100000:1.0:1788813147.976592:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 114 00000100:00100000:1.0:1788813147.976603:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+53:11353:x1875706301703936:12345-192.168.202.13@tcp:54:lfs.0 00010000:00010000:1.0:1788813147.976667:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703245 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.976686:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.976698:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.976731:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.976738:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703245 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.976760:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703245 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.976766:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813147.976771:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703245 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.976779:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703245 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.976792:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813147.976795:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813147.976800:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703245 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813147.976806:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703245 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813147.976880:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+53:11353:x1875706301703936:12345-192.168.202.13@tcp:54:lfs.0 Request processed in 278us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813147.976888:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 114 00000100:00100000:1.0:1788813147.986439:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813147.986780:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301704192 00000100:00100000:2.0:1788813147.986790:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301704192 00000100:00100000:2.0:1788813147.986852:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:2.0:1788813147.986864:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+53:11353:x1875706301704192:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813147.987149:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+54:11353:x1875706301704192:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 287us (719us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788813147.987157:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:1.0:1788813148.004508:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813148.004534:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313301504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813148.004612:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813148.004734:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313301504 00000100:00100000:3.0:1788813148.004744:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313301504 00000100:00100000:3.0:1788813148.004795:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788813148.004805:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313301504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788813148.004839:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788813148.004899:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313301504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813148.004907:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788813148.005545:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313301504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813148.092980:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813148.093364:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301704448 00000100:00100000:1.0:1788813148.093376:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301704448 00000100:00100000:1.0:1788813148.093437:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 115 00000100:00100000:1.0:1788813148.093448:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+54:11363:x1875706301704448:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:1.0:1788813148.093492:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813148.093495:0:9156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788813148.093525:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7031c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297f4 expref: 54 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.093544:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:1.0:1788813148.093549:0:9156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813148.093563:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff70324c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729817 expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.093670:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703253 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.093686:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.093696:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813148.093708:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788813148.093825:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff70324c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729817 expref: 56 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.093841:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703253 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729817 expref: 55 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.093849:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813148.093852:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813148.093854:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dace00, rc 0) 00000100:00100000:1.0:1788813148.094022:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+55:11363:x1875706301704448:12345-192.168.202.13@tcp:101:bash.0 Request processed in 575us (1051us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788813148.094054:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 115 00000100:00100000:1.0:1788813148.098924:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813148.099051:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813148.099360:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301704576 00000100:00100000:0.0:1788813148.099372:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301704576 00000100:00100000:0.0:1788813148.099437:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 116 00000100:00100000:0.0:1788813148.099448:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+55:11363:x1875706301704576:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813148.099475:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813148.099497:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703261 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072981e expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.099531:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703268 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.099547:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.099575:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.099690:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703261 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072981e expref: 57 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.099872:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072981e expref: 56 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.099881:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:0.0:1788813148.099884:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788813148.099887:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f600, rc 0) 00000100:00100000:0.0:1788813148.100267:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+56:11363:x1875706301704576:12345-192.168.202.13@tcp:101:bash.0 Request processed in 819us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813148.100274:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 116 00000100:00100000:2.0:1788813148.100353:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301704704 00000100:00100000:2.0:1788813148.100358:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301704704 00000100:00100000:2.0:1788813148.100402:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:2.0:1788813148.100411:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+56:2399:x1875706301704704:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813148.100422:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813148.100437:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703253 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729817 expref: 56 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.100450:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:2.0:1788813148.100453:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813148.100569:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+55:2399:x1875706301704704:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 158us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813148.100577:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:1.0:1788813148.105372:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813148.105461:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301704960 00000100:00100000:3.0:1788813148.105471:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301704960 00000100:00100000:3.0:1788813148.105563:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 117 00000100:00100000:3.0:1788813148.105575:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+55:11363:x1875706301704960:12345-192.168.202.13@tcp:36:bash.0 00010000:00010000:3.0:1788813148.105630:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813148.105656:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703237 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729810 expref: 55 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.105675:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813148.105680:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813148.106449:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70326f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.106483:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70326f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.106493:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70326f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813148.106543:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1788813148.106567:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002412ba38 reply state 00000000daed90f5 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70326f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.106579:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70326f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.106586:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813148.106589:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788813148.106592:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813148.106742:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+57:11363:x1875706301704960:12345-192.168.202.13@tcp:36:bash.0 Request processed in 1168us (1379us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788813148.106750:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 117 00000020:00080000:3.0:1788813148.106757:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788813148.111017:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813148.111171:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301705088 00000100:00100000:2.0:1788813148.111182:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301705088 00000100:00100000:2.0:1788813148.111244:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 118 00000100:00100000:2.0:1788813148.111256:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+57:11363:x1875706301705088:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:2.0:1788813148.111282:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813148.111305:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703276 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729825 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.111451:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70327d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.111467:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70327d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.111480:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70327d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813148.111512:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788813148.111517:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788813148.111536:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70327d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.111565:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703276 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729825 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.111585:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70327d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729825 expref: 58 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.111596:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:2.0:1788813148.111599:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813148.111603:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09000, rc 0) 00000100:00100000:2.0:1788813148.111670:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+58:11363:x1875706301705088:12345-192.168.202.13@tcp:101:bash.0 Request processed in 417us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813148.111678:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 118 00000100:00100000:0.0:1788813148.125878:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813148.126034:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301705344 00000100:00100000:2.0:1788813148.126057:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301705344 00000100:00100000:2.0:1788813148.126149:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00100000:2.0:1788813148.126159:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+58:11363:x1875706301705344:12345-192.168.202.13@tcp:35:bash.0 00000100:00100000:2.0:1788813148.126433:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+59:11363:x1875706301705344:12345-192.168.202.13@tcp:35:bash.0 Request processed in 274us (563us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788813148.126441:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 29 00010000:00010000:2.0:1788813148.132564:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813148.228884:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813148.229407:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301705472 00000100:00100000:0.0:1788813148.229420:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301705472 00000100:00100000:0.0:1788813148.229498:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 119 00000100:00100000:0.0:1788813148.229509:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+59:11369:x1875706301705472:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813148.229533:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813148.229555:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703284 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072982c expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.229626:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70328b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.229660:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70328b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.229673:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70328b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813148.229728:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788813148.229732:0:12571:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813148.229754:0:12571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70328b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.229779:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff703284 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072982c expref: 61 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.229882:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70328b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072982c expref: 60 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.229890:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:0.0:1788813148.229894:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813148.229897:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f200, rc 0) 00000100:00100000:0.0:1788813148.230290:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+60:11369:x1875706301705472:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 782us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813148.230298:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 119 00000100:00100000:1.0:1788813148.235498:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813148.235602:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301705600 00000100:00100000:3.0:1788813148.235617:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301705600 00000100:00100000:3.0:1788813148.235699:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 120 00000100:00100000:3.0:1788813148.235713:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+60:11369:x1875706301705600:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813148.235743:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813148.235772:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703292 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729833 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.235872:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703299 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.235888:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703299 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.235900:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703299 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.235912:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.235920:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.235926:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236198:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff7032a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236210:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff7032a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236218:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff7032a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813148.236264:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788813148.236268:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813148.236291:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff7032a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236313:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff7032a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236322:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703299 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236330:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703299 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236337:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703299 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236344:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813148.236348:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703299 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236356:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703299 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236367:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:3.0:1788813148.236370:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813148.236375:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703299 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236381:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703299 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236393:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236399:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236413:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236418:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813148.236421:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236428:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236435:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a74a15f00) 00010000:00010000:3.0:1788813148.236437:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813148.236439:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236445:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236472:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703292 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729833 expref: 62 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236486:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff7032a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729833 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.236493:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813148.236495:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813148.236497:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657e00, rc 0) 00000100:00100000:3.0:1788813148.236573:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+61:11369:x1875706301705600:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 863us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813148.236592:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 120 00000100:00100000:3.0:1788813148.243148:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813148.244031:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301705856 00000100:00100000:2.0:1788813148.244052:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301705856 00000100:00100000:2.0:1788813148.244118:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 121 00000100:00100000:2.0:1788813148.244128:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+61:11369:x1875706301705856:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813148.244147:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813148.244296:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7032ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072983a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.244414:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.244429:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70327d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729825 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.244437:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff7032a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729833 expref: 62 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.244445:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.244481:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff7032a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729833 expref: 62 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.244514:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff7032a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729833 expref: 62 pid: 6495 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813148.244527:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1875706313301632:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813148.244629:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70327d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729825 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.244638:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70327d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729825 expref: 62 pid: 6496 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813148.244647:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a89ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1875706313301760:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813148.244671:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813148.250258:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813148.250299:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813148.250465:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301705984 00000100:00100000:1.0:1788813148.250476:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301705984 00010000:00010000:1.0:1788813148.250521:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff7032a7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729833 expref: 63 pid: 6495 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813148.250566:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301706112 00000100:00100000:1.0:1788813148.250570:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301706112 00010000:00010000:1.0:1788813148.250583:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70327d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729825 expref: 64 pid: 6496 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813148.250607:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 70 00000100:00100000:1.0:1788813148.250617:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943423800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+64:2398:x1875706301705984:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813148.250632:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813148.250638:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff7032a7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729833 expref: 64 pid: 6495 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.250652:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff7032a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729833 expref: 64 pid: 6495 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.250674:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813148.250695:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.250704:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.250710:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813148.250763:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943423800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+64:2398:x1875706301705984:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 147us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813148.250772:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 70 00000100:00100000:1.0:1788813148.250870:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 71 00000100:00100000:1.0:1788813148.250878:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+63:2397:x1875706301706112:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813148.250886:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813148.250890:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70327d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729825 expref: 63 pid: 6496 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.250900:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70327d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729825 expref: 63 pid: 6496 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.250913:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813148.250917:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.250926:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.250974:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.250994:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813148.251020:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+63:2397:x1875706301706112:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 143us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813148.251311:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 71 00010000:00010000:2.0:1788813148.252819:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff7032a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729833 expref: 62 pid: 6495 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813148.252849:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1875706313301632:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813148.252864:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70327d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729825 expref: 61 pid: 6496 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813148.252875:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a89ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1875706313301760:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813148.252900:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.252909:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.252978:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813148.253001:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788813148.253460:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7032ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072983a expref: 62 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.253479:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072983a expref: 61 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.253488:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:2.0:1788813148.253491:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788813148.253495:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08200, rc 0) 00000100:00100000:2.0:1788813148.253545:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+61:11369:x1875706301705856:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 9419us (10407us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788813148.253553:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 121 00000100:00100000:1.0:1788813148.260564:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813148.260664:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301706368 00000100:00100000:2.0:1788813148.260674:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301706368 00000100:00100000:2.0:1788813148.260797:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:2.0:1788813148.260809:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+61:11369:x1875706301706368:12345-192.168.202.13@tcp:103:lfs.0 00010000:00010000:2.0:1788813148.260827:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813148.260853:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703206 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729809 expref: 61 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.260872:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:2.0:1788813148.260876:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813148.260972:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+60:11369:x1875706301706368:12345-192.168.202.13@tcp:103:lfs.0 Request processed in 165us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813148.260980:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:3.0:1788813148.263818:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813148.263975:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301706496 00000100:00100000:0.0:1788813148.263987:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301706496 00000100:00100000:0.0:1788813148.264061:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 122 00000100:00100000:0.0:1788813148.264073:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+60:11369:x1875706301706496:12345-192.168.202.13@tcp:58:lfs.0 00010000:00010000:0.0:1788813148.264242:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff7032c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.264261:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff7032c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.264273:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff7032c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813148.264388:0:12571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788813148.264474:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+60:11369:x1875706301706496:12345-192.168.202.13@tcp:58:lfs.0 Request processed in 403us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813148.264483:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 122 00000100:00100000:0.0:1788813148.267975:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813148.268062:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301706624 00000100:00100000:1.0:1788813148.268076:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301706624 00000100:00100000:1.0:1788813148.268150:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 123 00000100:00100000:1.0:1788813148.268171:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+60:11369:x1875706301706624:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813148.268196:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813148.268219:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff7032ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729841 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.268277:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff7032c3 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.268288:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff7032ca lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729841 expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.268308:0:6494:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff7032c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.268322:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff7032ca lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729841 expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.268339:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813148.268342:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813148.268346:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff7032ca lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729841 expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.268376:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43daca00, rc 0) 00000100:00100000:1.0:1788813148.268455:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+61:11369:x1875706301706624:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 287us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813148.268461:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 123 00000040:00080000:2.0:1788813148.644158:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813148.644168:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813148.644192:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788813148.644210:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813148.644632:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a89ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875706313301888:192.168.202.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788813148.644878:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813148.659500:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813148.659590:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301706752 00000100:00100000:1.0:1788813148.659601:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301706752 00000100:00100000:1.0:1788813148.659664:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 124 00000100:00100000:1.0:1788813148.659675:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+62:11370:x1875706301706752:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788813148.659709:0:6496:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788813148.659840:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+62:11370:x1875706301706752:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 Request processed in 166us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813148.659847:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 124 00000100:00100000:2.0:1788813148.660915:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a89ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875706313301888:192.168.202.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788813148.674435:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813148.674625:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301706880 00000100:00100000:3.0:1788813148.674637:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301706880 00000100:00100000:3.0:1788813148.674707:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 125 00000100:00100000:3.0:1788813148.674716:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+61:11370:x1875706301706880:12345-192.168.202.13@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788813148.674903:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7032d1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.674923:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7032d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.674965:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7032d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.674980:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.674985:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.674989:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675011:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7032df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675018:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7032df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675059:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7032df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813148.675130:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788813148.675134:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813148.675149:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7032df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675158:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7032d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675163:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7032d1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675169:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7032d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675173:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813148.675176:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7032d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675182:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7032d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675192:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6fe40300) 00010000:00010000:3.0:1788813148.675194:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813148.675198:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7032d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675203:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7032d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675222:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675227:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032d8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675230:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675233:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813148.675235:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675238:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032d8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675242:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff948a764be900) 00010000:00010000:3.0:1788813148.675244:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813148.675245:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032d8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675248:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7032d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675259:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7032df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675263:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7032df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675266:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7032df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675273:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813148.675275:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7032df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675279:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7032df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675283:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813148.675284:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813148.675286:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7032df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.675289:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7032df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813148.675374:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+61:11370:x1875706301706880:12345-192.168.202.13@tcp:34:lhsmtool_posix.0 Request processed in 658us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813148.675382:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 125 00000100:00100000:3.0:1788813148.682214:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813148.682390:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301707136 00000100:00100000:1.0:1788813148.682404:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301707136 00000100:00100000:1.0:1788813148.682494:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 126 00000100:00100000:1.0:1788813148.682507:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+61:11370:x1875706301707136:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813148.682536:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813148.682563:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff7032e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729848 expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.682764:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7032ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.682833:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7032ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.682870:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7032ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813148.682886:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788813148.683019:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7032ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.683025:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7032ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.683030:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7032ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.683034:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dada00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813148.683320:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7032ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.683331:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7032ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.683346:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813148.683355:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788813148.683361:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7032ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.683367:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff7032ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.683428:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff7032e6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729848 expref: 63 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.683448:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6fe40300) 00010000:00010000:1.0:1788813148.683449:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813148.683453:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff7032e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729848 expref: 63 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.683461:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dade00, rc 0) 00000100:00100000:1.0:1788813148.683539:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+62:11370:x1875706301707136:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 1034us (1336us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1788813148.683547:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 126 00000100:00100000:2.0:1788813148.688129:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813148.688303:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301707264 00000100:00100000:3.0:1788813148.688318:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301707264 00000100:00100000:3.0:1788813148.688403:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 127 00000100:00100000:3.0:1788813148.688414:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+62:11370:x1875706301707264:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788813148.688458:0:12571:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788813148.688599:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+62:11370:x1875706301707264:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 Request processed in 186us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813148.688607:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 127 00000100:00100000:3.0:1788813148.694377:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813148.705019:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301707520 00000100:00100000:1.0:1788813148.705048:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301707520 00000100:00100000:2.0:1788813148.705248:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 128 00000100:00100000:2.0:1788813148.705261:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+62:11370:x1875706301707520:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813148.705292:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813148.705297:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788813148.705333:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70328b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072982c expref: 62 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.705359:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:2.0:1788813148.705367:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813148.705388:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7032fb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072984f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788813148.705913:0:6494:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788813148.706149:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703302 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.706187:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703302 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.706199:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703302 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.706263:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7032fb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072984f expref: 64 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.706281:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703302 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072984f expref: 63 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.706288:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948943001a00) 00010000:00010000:2.0:1788813148.706291:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813148.706294:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09200, rc 0) 00000100:00100000:2.0:1788813148.706401:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+63:11370:x1875706301707520:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 1141us (12039us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788813148.706409:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 128 00000100:00100000:3.0:1788813148.712341:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813148.712459:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301707776 00000100:00100000:1.0:1788813148.712473:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301707776 00000100:00100000:1.0:1788813148.712567:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 129 00000100:00100000:1.0:1788813148.712581:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+63:11370:x1875706301707776:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788813148.712701:0:9156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813148.713020:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703302 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072984f expref: 63 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.714312:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948943001a00) 00010000:00010000:1.0:1788813148.715251:0:9156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813148.715468:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703310 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.715492:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703310 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.715816:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703310 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725269:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703317 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x41675614 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725294:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703317 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x41675614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725307:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703317 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x41675614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725379:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703310 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725387:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703310 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725394:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703310 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725400:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166fc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813148.725405:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703310 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725413:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703310 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725425:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:0.0:1788813148.725429:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813148.725434:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703310 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725439:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703310 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725455:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703317 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x41675614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725461:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703317 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x41675614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725467:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703317 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x41675614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725481:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813148.725484:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703317 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x41675614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725490:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703317 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x41675614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725497:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x41675614 (ffff948a74a15200) 00010000:00010000:0.0:1788813148.725499:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813148.725502:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703317 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x41675614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.725507:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703317 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x41675614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813148.725617:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+62:11370:x1875706301707776:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 13034us (13287us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813148.725626:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 129 00000100:00100000:3.0:1788813148.728660:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813148.728823:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301707904 00000100:00100000:1.0:1788813148.728838:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301707904 00000100:00100000:1.0:1788813148.728963:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 130 00000100:00100000:1.0:1788813148.728977:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+62:11370:x1875706301707904:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813148.729026:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813148.729058:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff70331e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729856 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.729115:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703325 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.729132:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.729146:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.729527:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff70331e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729856 expref: 64 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.729553:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703325 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729856 expref: 63 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.729564:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948a584a3f00) 00010000:00010000:2.0:1788813148.729567:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788813148.729572:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dada00, rc 0) 00000100:00100000:2.0:1788813148.729659:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+63:11370:x1875706301707904:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 685us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813148.729668:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 130 00000100:00100000:3.0:1788813148.749695:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813148.750326:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301708160 00000100:00100000:1.0:1788813148.750343:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301708160 00000100:00100000:1.0:1788813148.750426:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 131 00000100:00100000:1.0:1788813148.750438:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+63:11370:x1875706301708160:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788813148.750573:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70332c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.750595:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70332c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.750609:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70332c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813148.752831:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788813148.752860:0:6496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 301771927399ns, next at 302771918241ns, rc = 0 00000004:00010000:2.0:1788813148.752984:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3c0fa37 reply state 000000005c711de3 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70332c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.753011:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70332c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.753020:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948a584a3f00) 00010000:00010000:2.0:1788813148.753024:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788813148.753029:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813148.753675:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+65:11370:x1875706301708160:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 3231us (3988us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788813148.753686:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 131 00000100:00100000:3.0:1788813148.756510:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813148.756623:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301708288 00000100:00100000:0.0:1788813148.756641:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301708288 00000100:00100000:0.0:1788813148.756729:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 132 00000100:00100000:0.0:1788813148.756742:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+65:11370:x1875706301708288:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813148.756771:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813148.756793:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703333 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072985d expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.756865:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703333 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072985d expref: 66 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.756901:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703333 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072985d expref: 66 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.756921:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948a584a3f00) 00010000:00010000:0.0:1788813148.756924:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813148.756928:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f400, rc 0) 00000100:00100000:0.0:1788813148.757044:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+66:11370:x1875706301708288:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 304us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813148.757051:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 132 00000100:00100000:3.0:1788813148.762309:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813148.762433:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301708416 00000100:00100000:1.0:1788813148.762451:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301708416 00000100:00100000:1.0:1788813148.762575:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 45 00000100:00100000:1.0:1788813148.762589:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894407b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2397:x1875706301708416:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788813148.762970:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894407b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2397:x1875706301708416:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 Request processed in 383us (670us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788813148.762979:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 45 00000100:00080000:0.0:1788813148.763266:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813148.769642:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813148.772288:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301708672 00000100:00100000:2.0:1788813148.772308:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301708672 00000100:00100000:2.0:1788813148.772402:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:2.0:1788813148.772416:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+66:11370:x1875706301708672:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788813148.773164:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+67:11370:x1875706301708672:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 747us (3532us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788813148.773174:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:3.0:1788813148.777009:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813148.777207:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301708928 00000100:00100000:2.0:1788813148.777225:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301708928 00000100:00100000:2.0:1788813148.777324:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 133 00000100:00100000:2.0:1788813148.777338:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894407a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+67:11370:x1875706301708928:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788813148.780675:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894407a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+67:11370:x1875706301708928:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 3322us (3655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813148.780693:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 133 00000100:00100000:3.0:1788813148.784333:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813148.784645:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301709056 00000100:00100000:2.0:1788813148.784665:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301709056 00000100:00100000:2.0:1788813148.784758:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 134 00000100:00100000:2.0:1788813148.784771:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894407b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+67:11370:x1875706301709056:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813148.784799:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813148.784828:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70333a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729864 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.784926:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703341 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.784996:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.785011:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813148.786403:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788813148.786443:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.786494:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70333a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729864 expref: 69 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.786533:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703341 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729864 expref: 68 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.786572:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948a584a3f00) 00010000:00010000:2.0:1788813148.786576:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788813148.786580:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08800, rc 0) 00000100:00100000:2.0:1788813148.786678:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894407b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+68:11370:x1875706301709056:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 1907us (2352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813148.786688:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 134 00000100:00100000:1.0:1788813148.807713:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813148.807910:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301709184 00000100:00100000:3.0:1788813148.807923:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301709184 00000100:00100000:3.0:1788813148.808035:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00100000:3.0:1788813148.808058:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2397:x1875706301709184:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813148.808093:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813148.808121:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ebf3a4f/0xf32533d6ff703348 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072986b expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813148.808156:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f1f5d, blocks: 0x0 00010000:00010000:3.0:1788813148.808183:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1788813148.808188:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813148.808200:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ebf3a4f/0xf32533d6ff703348 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072986b expref: 10 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.808222:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ebf3a4f/0xf32533d6ff703348 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072986b expref: 10 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.808239:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656000, rc 0) 00000100:00100000:3.0:1788813148.808314:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+10:2397:x1875706301709184:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 261us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813148.808340:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00100000:3.0:1788813148.814128:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813148.814240:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301709440 00000100:00100000:2.0:1788813148.814257:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301709440 00000100:00100000:2.0:1788813148.814341:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 135 00000100:00100000:2.0:1788813148.814355:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+68:11370:x1875706301709440:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788813148.814483:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+68:11370:x1875706301709440:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 134us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813148.814488:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 135 00000100:00100000:2.0:1788813148.817772:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813148.818487:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301709568 00000100:00100000:1.0:1788813148.818512:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301709568 00000100:00100000:1.0:1788813148.818639:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 47 00000100:00100000:1.0:1788813148.818651:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+10:11370:x1875706301709568:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813148.818679:0:10066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813148.818704:0:10066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ce0163b/0xf32533d6ff70334f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729872 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.818811:0:10066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ebf3a4f/0xf32533d6ff703348 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072986b expref: 11 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.818823:0:10066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813148.818828:0:10066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813148.818833:0:10066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ce0163b/0xf32533d6ff70334f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729872 expref: 11 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.818877:0:10066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ebf3a4f/0xf32533d6ff703348 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072986b expref: 11 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.818895:0:10066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ebf3a4f/0xf32533d6ff703348 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072986b expref: 11 pid: 8405 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813148.818968:0:10066:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943460000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10066:1875706313302016:192.168.202.13@tcp:104: 00000100:00100000:1.0:1788813148.819307:0:10066:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436b2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813148.826013:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813148.826205:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301709696 00000100:00100000:3.0:1788813148.826217:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301709696 00010000:00010000:3.0:1788813148.826272:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ebf3a4f/0xf32533d6ff703348 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072986b expref: 12 pid: 8405 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813148.826318:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:3.0:1788813148.826331:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+12:2396:x1875706301709696:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813148.826353:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813148.826386:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ebf3a4f/0xf32533d6ff703348 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072986b expref: 12 pid: 8405 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.826402:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ebf3a4f/0xf32533d6ff703348 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072986b expref: 12 pid: 8405 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.826434:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813148.826438:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813148.826449:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ce0163b/0xf32533d6ff70334f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729872 expref: 12 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.826460:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ce0163b/0xf32533d6ff70334f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729872 expref: 12 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.826585:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004ce0163b/0xf32533d6ff70334f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729872 expref: 12 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813148.826625:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894407b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6480:1875706313302144:192.168.202.13@tcp:105: 00000100:00100000:3.0:1788813148.826866:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942dab000 going to sleep for 11 seconds 00010000:00010000:0.0:1788813148.829004:0:10066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ebf3a4f/0xf32533d6ff703348 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072986b expref: 12 pid: 8405 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813148.829176:0:10066:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943460000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10066:1875706313302016:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813148.829224:0:10066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ce0163b/0xf32533d6ff70334f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729872 expref: 11 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.829241:0:10066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac400, rc 0) 00000100:00100000:0.0:1788813148.829415:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+11:11370:x1875706301709568:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 10765us (11658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813148.829426:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 47 00000100:00100000:3.0:1788813148.842087:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894407b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6480:1875706313302144:192.168.202.13@tcp:105: 00000100:00100000:1.0:1788813148.842114:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00010000:00010000:3.0:1788813148.842119:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813148.842294:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+10:2396:x1875706301709696:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 15964us (16296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813148.842297:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301709824 00000100:00100000:0.0:1788813148.842311:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301709824 00000100:00100000:3.0:1788813148.842317:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 72 00002000:00100000:0.0:1788813148.842379:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff948a76404000 x1875706301709824/t0(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:719/0 lens 504/0 e 0 to 0 dl 1788813159 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813148.842431:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948a76404000 with x1875706301709824 ext(0->12) 00002000:00010000:0.0:1788813148.842438:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948a76404000 00000100:00100000:0.0:1788813148.842476:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2 00000100:00100000:0.0:1788813148.842487:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+10:2398:x1875706301709824:12345-192.168.202.13@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788813148.848803:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+12:2398:x1875706301709824:12345-192.168.202.13@tcp:4:lhsmtool_posix.0 Request processed in 6225us (6606us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788813148.848826:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2 00002000:00100000:0.0:1788813148.848845:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff948a76404000 x1875706301709824/t4294967309(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:719/0 lens 504/448 e 0 to 0 dl 1788813159 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813148.848860:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948a76404000 with x1875706301709824 ext(0->12) 00002000:00010000:0.0:1788813148.848870:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948a76404000 00000100:00100000:1.0:1788813148.855959:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813148.856058:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301709952 00000100:00100000:2.0:1788813148.856068:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301709952 00000100:00100000:2.0:1788813148.856125:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 136 00000100:00100000:2.0:1788813148.856134:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+68:11370:x1875706301709952:12345-192.168.202.13@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788813148.858486:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1788813148.858500:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1788813148.858527:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788813148.858549:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9489435a4540 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788813148.858554:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948a48db0300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9489435a4a80 00000020:00080000:1.0:1788813148.858557:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948a48db0500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff948a42be0a00 00000004:00080000:1.0:1788813148.858584:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788813148.858607:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff948a7b5d43c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788813148.858610:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94894345fa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff948a7b5d4480 00000020:00080000:1.0:1788813148.858612:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94894345f200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff948943522400 00000020:00080000:1.0:1788813148.858632:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788813148.858687:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788813148.858844:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813148.858862:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313302272:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788813148.858922:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813148.859585:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:11370:x1875706301709952:12345-192.168.202.13@tcp:44:lhsmtool_posix.0 Request processed in 3448us (3651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813148.859597:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 136 00010000:00010000:3.0:1788813148.860970:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703054 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.860984:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703054 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.860991:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703054 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.860997:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813148.861002:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703054 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861010:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703054 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861024:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948943001300) 00010000:00010000:3.0:1788813148.861028:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813148.861032:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703054 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861475:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703054 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861506:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861513:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861518:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861521:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813148.861524:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861529:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861537:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948a584a3900) 00010000:00010000:3.0:1788813148.861539:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813148.861543:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030fc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861548:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7030fc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861561:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70317a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861566:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70317a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861577:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70317a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861581:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813148.861583:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70317a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861588:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70317a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861595:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a74a15f00) 00010000:00010000:3.0:1788813148.861598:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813148.861601:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70317a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861607:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70317a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861617:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff70319d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861622:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff70319d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861626:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff70319d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861630:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813148.861643:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff70319d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861658:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff70319d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861666:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a74a15f00) 00010000:00010000:3.0:1788813148.861669:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813148.861672:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff70319d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861678:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff70319d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861694:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70326f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861700:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70326f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861705:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70326f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861710:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813148.861712:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70326f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861717:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70326f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861724:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813148.861727:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813148.861730:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70326f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861744:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70326f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861756:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70332c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861762:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70332c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.861767:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70332c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813148.861962:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313302528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788813148.862024:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813148.862095:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813148.862102:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6a89e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313302400:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788813148.862141:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813148.862377:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313302272 00000100:00100000:2.0:1788813148.862387:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313302272 00000100:00100000:2.0:1788813148.862428:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313302528 00000100:00100000:2.0:1788813148.862435:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313302528 00000100:00100000:2.0:1788813148.862462:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313302400 00000100:00100000:2.0:1788813148.862464:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313302400 00000100:00100000:2.0:1788813148.862474:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788813148.862481:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313302272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788813148.862504:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:2.0:1788813148.862533:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f1f5c, atime: 0x6a9f1f5c, ctime: 0x6a9f1f5c, blocks: 0x8 00010000:00010000:2.0:1788813148.862539:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703356 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.862553:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1788813148.862556:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813148.862562:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.862576:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.862584:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.862591:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703356 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.862606:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788813148.862733:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3627:x1875706313302272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 252us (3810us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788813148.862739:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788813148.862760:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788813148.862765:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3626:x1875706313302528:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1788813148.863843:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948a764c8a80/2, rc 0, transno 4294967305 00000100:00100000:0.0:1788813148.863854:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313302272:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788813148.863883:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813148.863894:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3626:x1875706313302400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788813148.863912:0:10066:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1788813148.863957:0:10066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b79c582e/0xf32533d6ff70335d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.863977:0:10066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d38c805e/0xf32533d6ff70310a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ca expref: 11 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.863994:0:10066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788813148.863998:0:10066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813148.864002:0:10066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b79c582e/0xf32533d6ff70335d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.864037:0:10066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d38c805e/0xf32533d6ff70310a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ca expref: 11 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.864379:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813148.864385:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70332c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.864393:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70332c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.864408:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948a584a3f00) 00010000:00010000:3.0:1788813148.864410:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788813148.864415:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70332c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.864420:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff70332c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813148.864489:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813148.864509:0:8405:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788813148.864515:0:8405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788813148.864621:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301710080 00000100:00100000:3.0:1788813148.864634:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301710080 00000100:00100000:3.0:1788813148.864726:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 51 00000100:00100000:3.0:1788813148.864734:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894407b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+12:2397:x1875706301710080:12345-192.168.202.13@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1788813148.864861:0:10066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d38c805e/0xf32533d6ff70310a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ca expref: 12 pid: 10066 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813148.864877:0:10066:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10066:1875706313302656:192.168.202.13@tcp:104: 00000100:00100000:0.0:1788813148.864972:0:10066:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943057c00 going to sleep for 11 seconds 00000100:00080000:1.0:1788813148.865448:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1788813148.866641:0:8403:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788813148.866648:0:8403:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788813149 00002000:00010000:2.0:1788813148.866651:0:8403:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788813148.866653:0:8403:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788813149 -> 1788813149 00002000:00010000:2.0:1788813148.866655:0:8403:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788813148.866723:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3626:x1875706313302528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3955us (4696us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788813148.866733:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1788813148.866766:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813148.866788:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703356 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.866800:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813148.866805:0:7900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703356 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.866826:0:7900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703356 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.866845:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703356 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.866854:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703356 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.866889:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813148.866892:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813148.866894:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788813148.867177:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948943640000/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788813148.867185:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313302528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788813148.869298:0:10066:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10066:1875706313302656:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813148.869328:0:10066:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b79c582e/0xf32533d6ff70335d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813148.872454:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813148.872851:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301710208 00000100:00100000:1.0:1788813148.872862:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301710208 00010000:00010000:1.0:1788813148.872910:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d38c805e/0xf32533d6ff70310a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ca expref: 13 pid: 10066 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813148.873245:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 73 00000100:00100000:2.0:1788813148.873259:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50686c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+13:2397:x1875706301710208:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813148.873276:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813148.873283:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d38c805e/0xf32533d6ff70310a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ca expref: 13 pid: 10066 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.873297:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d38c805e/0xf32533d6ff70310a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ca expref: 13 pid: 10066 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.873325:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d38c805e/0xf32533d6ff70310a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.13@tcp remote: 0x709a1244a07297ca expref: 13 pid: 10066 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.873347:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813148.873352:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813148.873357:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b79c582e/0xf32533d6ff70335d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.873368:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b79c582e/0xf32533d6ff70335d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.873398:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813148.873461:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50686c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+12:2397:x1875706301710208:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 206us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813148.873469:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 73 00010000:00010000:3.0:1788813148.873681:0:10066:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b79c582e/0xf32533d6ff70335d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.873692:0:10066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b79c582e/0xf32533d6ff70335d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.873702:0:10066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b79c582e/0xf32533d6ff70335d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.873710:0:10066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b79c582e/0xf32533d6ff70335d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.873730:0:10066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813148.874142:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813148.874149:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b79c582e/0xf32533d6ff70335d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.874167:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166fc00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813148.874172:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b79c582e/0xf32533d6ff70335d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.874181:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b79c582e/0xf32533d6ff70335d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.874195:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b79c582e/0xf32533d6ff70335d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.874202:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b79c582e/0xf32533d6ff70335d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.874220:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813148.874221:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813148.874223:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813148.874309:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3626:x1875706313302400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10417us (12165us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788813148.874318:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:1.0:1788813148.874409:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948a6a89e300/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788813148.874417:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6a89e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313302400:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788813148.877338:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1788813148.877351:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1788813148.877508:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894407b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301710080:12345-192.168.202.13@tcp:16:lhsmtool_posix.0 Request processed in 12770us (13014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813148.877519:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 51 00000100:00100000:3.0:1788813148.887128:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813148.887349:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301710464 00000100:00100000:2.0:1788813148.887360:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301710464 00000100:00100000:2.0:1788813148.887423:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 137 00000100:00100000:2.0:1788813148.887453:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:11370:x1875706301710464:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788813148.887514:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813148.887544:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703341 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729864 expref: 16 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.887564:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948a584a3f00) 00010000:00010000:2.0:1788813148.887570:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813148.887599:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703364 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.887612:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703364 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.887621:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703364 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813148.887730:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000949b709c reply state 0000000051f99dd5 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703364 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.887740:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703364 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.887746:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948a584a3f00) 00010000:00010000:2.0:1788813148.887748:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788813148.887750:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813148.887850:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+17:11370:x1875706301710464:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 404us (732us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788813148.887857:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 137 00000100:00100000:2.0:1788813148.890910:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813148.892012:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301710592 00000100:00100000:3.0:1788813148.892025:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301710592 00000100:00100000:3.0:1788813148.892104:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 52 00000100:00100000:3.0:1788813148.892115:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2396:x1875706301710592:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788813148.892335:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788813148.892352:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788813149 -> 1788813148 00002000:00010000:3.0:1788813148.892354:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788813148 00002000:00010000:3.0:1788813148.892357:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788813149 -> 1788813148 00002000:00010000:3.0:1788813148.892360:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788813148.892434:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301710592:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 Request processed in 320us (1530us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788813148.892442:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 52 00000100:00100000:0.0:1788813148.895987:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813148.896140:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301710848 00000100:00100000:3.0:1788813148.896150:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301710848 00000100:00100000:3.0:1788813148.896215:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 138 00000100:00100000:3.0:1788813148.896226:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+17:11370:x1875706301710848:12345-192.168.202.13@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788813148.896301:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70336b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.896319:0:12571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703325 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729856 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.896329:0:12571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70336b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.896365:0:12571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703325 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729856 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.896379:0:12571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703325 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729856 expref: 17 pid: 6495 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813148.896394:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944078a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313302784:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813148.896481:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942dab900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813148.899852:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944078a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313302784:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813148.899882:0:12571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70336b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813148.903186:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813148.903734:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301710976 00000100:00100000:2.0:1788813148.903759:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301710976 00010000:00010000:2.0:1788813148.903816:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703325 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729856 expref: 18 pid: 6495 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813148.903859:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 74 00000100:00100000:2.0:1788813148.903869:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:2396:x1875706301710976:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813148.903883:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813148.903889:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703325 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729856 expref: 18 pid: 6495 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.903902:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703325 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729856 expref: 18 pid: 6495 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.903924:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703325 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729856 expref: 18 pid: 6495 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.903981:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948a584a3f00) 00010000:00010000:2.0:1788813148.903987:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70336b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.903997:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70336b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.904006:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70336b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.904027:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813148.904097:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+17:2396:x1875706301710976:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 229us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813148.904113:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 74 00010000:00010000:0.0:1788813148.904647:0:12571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70336b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.904657:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70336b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.904694:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70336b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.904709:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70336b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.904716:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70336b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.904723:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813148.904727:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70336b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.904735:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70336b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.904745:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948a584a3f00) 00010000:00010000:0.0:1788813148.904748:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788813148.904752:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70336b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.904758:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70336b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813148.904827:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:11370:x1875706301710848:12345-192.168.202.13@tcp:55:lhsmtool_posix.0 Request processed in 8603us (8849us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788813148.904836:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 138 00000100:00100000:0.0:1788813148.913005:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813148.913111:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301711104 00000100:00100000:2.0:1788813148.913121:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301711104 00000100:00100000:2.0:1788813148.913184:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 53 00000100:00100000:2.0:1788813148.913193:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301711104:12345-192.168.202.13@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788813148.913236:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703372 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.913256:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ce0163b/0xf32533d6ff70334f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729872 expref: 7 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.913265:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813148.913269:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813148.913273:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703372 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.913309:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ce0163b/0xf32533d6ff70334f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729872 expref: 7 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.913323:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ce0163b/0xf32533d6ff70334f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729872 expref: 7 pid: 10066 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813148.913338:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eaeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1875706313302912:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813148.913414:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788813148.921569:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eaeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1875706313302912:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813148.921617:0:8404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703372 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813148.926187:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813148.932346:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301711232 00000100:00100000:3.0:1788813148.932362:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301711232 00010000:00010000:3.0:1788813148.932415:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ce0163b/0xf32533d6ff70334f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729872 expref: 8 pid: 10066 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813148.932469:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 75 00000100:00100000:3.0:1788813148.932480:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2396:x1875706301711232:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813148.932498:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813148.932521:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ce0163b/0xf32533d6ff70334f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729872 expref: 8 pid: 10066 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.932536:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ce0163b/0xf32533d6ff70334f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729872 expref: 8 pid: 10066 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.932563:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ce0163b/0xf32533d6ff70334f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729872 expref: 8 pid: 10066 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.932580:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813148.932585:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813148.932591:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703372 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.932601:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703372 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.932662:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813148.933190:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301711232:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 709us (7010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813148.933198:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 75 00010000:00010000:0.0:1788813148.933347:0:8404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703372 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.933371:0:8404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703372 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.933395:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703372 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.933404:0:8404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703372 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.933411:0:8404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703372 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.933418:0:8404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813148.933422:0:8404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703372 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.933430:0:8404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703372 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.933443:0:8404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703372 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.933450:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703372 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813148.933514:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2396:x1875706301711104:12345-192.168.202.13@tcp:1:lhsmtool_posix.0 Request processed in 20323us (20519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813148.933523:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 53 00000100:00100000:0.0:1788813148.939138:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813148.939296:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301711488 00000100:00100000:2.0:1788813148.939307:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301711488 00000100:00100000:2.0:1788813148.939369:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 139 00000100:00100000:2.0:1788813148.939379:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:11370:x1875706301711488:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788813148.939458:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703379 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.939475:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703268 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072981e expref: 16 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.939484:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703379 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.939517:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072981e expref: 16 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813148.939530:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703268 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072981e expref: 16 pid: 12571 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813148.939545:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eaeea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313303040:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813148.939630:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788813148.942745:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eaeea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313303040:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813148.942772:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703379 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813148.943586:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813148.943792:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301711616 00000100:00100000:1.0:1788813148.943801:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301711616 00010000:00010000:1.0:1788813148.944056:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703268 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072981e expref: 17 pid: 12571 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813148.944101:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 76 00000100:00100000:1.0:1788813148.944111:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+17:2396:x1875706301711616:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813148.944127:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813148.944133:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703268 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072981e expref: 17 pid: 12571 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.944147:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072981e expref: 17 pid: 12571 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.944291:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703268 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072981e expref: 17 pid: 12571 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.944308:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813148.944314:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff7032ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729841 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.944325:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703379 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.944332:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703379 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.944340:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703379 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813148.944460:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813148.944506:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:2396:x1875706301711616:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 396us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813148.944514:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 76 00010000:00010000:3.0:1788813148.950505:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703379 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.950522:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703379 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.950701:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703380 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.950718:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703333 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072985d expref: 16 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.950727:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703380 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.950765:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703333 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072985d expref: 16 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.950794:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703333 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072985d expref: 16 pid: 9156 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813148.950821:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944078a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313303168:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813148.950909:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942daba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813148.959171:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944078a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313303168:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813148.959205:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703380 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813148.959879:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813148.960100:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301711744 00000100:00100000:3.0:1788813148.960108:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301711744 00010000:00010000:3.0:1788813148.960147:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703333 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072985d expref: 17 pid: 9156 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813148.960194:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 77 00000100:00100000:3.0:1788813148.960205:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+17:2396:x1875706301711744:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813148.960219:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813148.960225:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703333 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072985d expref: 17 pid: 9156 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.960238:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703333 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072985d expref: 17 pid: 9156 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.960259:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703333 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072985d expref: 17 pid: 9156 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.960275:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948a584a3f00) 00010000:00010000:3.0:1788813148.960280:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703380 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.960290:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703380 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.960298:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703380 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813148.960339:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813148.960390:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:2396:x1875706301711744:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 187us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813148.960398:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 77 00010000:00010000:0.0:1788813148.960781:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703380 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.960790:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703380 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813148.960905:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788813148.961484:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788813148.961528:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788813148.961607:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944026d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6495:1875706313303296:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788813148.961659:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813148.961738:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943057840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813148.964623:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313303296 00000100:00100000:2.0:1788813148.964638:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313303296 00000100:00100000:2.0:1788813148.964743:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788813148.964754:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6495:x1875706313303296:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788813148.964900:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6495:x1875706313303296:12345-0@lo:1000:mdt00_001.0 Request processed in 148us (3240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813148.964907:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788813148.964987:0:6495:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788813148.964995:0:6495:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1788813148.965015:0:6495:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff948943640000, transno 4294967310 00000100:00100000:0.0:1788813148.965047:0:6495:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff948a6a89e300 x1875706313302400/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788813164 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813148.965060:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944026d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6495:1875706313303296:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788813148.965225:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1788813148.965303:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944026d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6495:1875706313303424:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788813148.965354:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813148.984625:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943057cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813148.989729:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313303424 00000100:00100000:3.0:1788813148.989746:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313303424 00000100:00100000:3.0:1788813148.989832:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788813148.989843:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6495:x1875706313303424:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788813148.990181:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6495:x1875706313303424:12345-0@lo:1000:mdt00_001.0 Request processed in 339us (24825us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788813148.990189:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788813148.990344:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944026d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6495:1875706313303424:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788813148.990394:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703380 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.990405:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703380 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.990413:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703380 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.990419:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813148.990423:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703380 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.990431:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703380 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.990448:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948a584a3f00) 00010000:00010000:0.0:1788813148.990451:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813148.990456:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703380 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.990463:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff703380 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.990488:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff7032c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.990495:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff7032c3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.990517:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff7032c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.990522:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166ec00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813148.990526:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff7032c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.990532:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff7032c3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.990542:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:0.0:1788813148.990544:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813148.990550:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff7032ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729841 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.990561:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff7032ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729841 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.990569:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff7032ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729841 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.990603:0:6495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff7032ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729841 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813148.990616:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944025180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313303552:192.168.202.13@tcp:105: 00000100:00100000:0.0:1788813148.990700:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943057cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813148.993223:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944025180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313303552:192.168.202.13@tcp:105: 00010000:00010000:0.0:1788813148.993265:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff7032c3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993275:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff7032c3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993311:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703387 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993334:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703387 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993345:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703387 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993355:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703387 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993362:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703387 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993367:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703387 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993372:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813148.993377:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703387 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993384:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703387 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993396:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:0.0:1788813148.993399:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813148.993410:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703387 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993416:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703387 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993427:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703379 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993433:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703379 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993439:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703379 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993444:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813148.993446:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703379 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993452:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703379 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993459:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:0.0:1788813148.993461:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788813148.993464:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703379 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813148.993469:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703379 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813148.993640:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:11370:x1875706301711488:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 54260us (54835us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788813148.993651:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 139 00000020:00080000:0.0:1788813148.993664:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788813148.993994:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813148.994000:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813148.994550:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788813148.994560:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788813148.998221:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813148.998543:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301711872 00000100:00100000:2.0:1788813148.998554:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301711872 00000100:00100000:2.0:1788813148.998612:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:2.0:1788813148.998623:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:11369:x1875706301711872:12345-192.168.202.13@tcp:49:lfs.0 00000100:00100000:2.0:1788813148.998754:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:11369:x1875706301711872:12345-192.168.202.13@tcp:49:lfs.0 Request processed in 133us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813148.998762:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:3.0:1788813149.006352:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813149.006435:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813149.006503:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301712384 00000100:00100000:0.0:1788813149.006514:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301712384 00000100:00100000:0.0:1788813149.006595:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 140 00000100:00100000:0.0:1788813149.006607:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894407a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:11369:x1875706301712384:12345-192.168.202.13@tcp:58:lfs.0 00000100:00100000:2.0:1788813149.006683:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301712128 00000100:00100000:2.0:1788813149.006689:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301712128 00000100:00100000:2.0:1788813149.006727:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 32 00000100:00100000:2.0:1788813149.006735:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a612cd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:11370:x1875706301712128:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000040:00080000:0.0:1788813149.006787:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788813149.006867:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894407a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:11369:x1875706301712384:12345-192.168.202.13@tcp:58:lfs.0 Request processed in 261us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813149.006877:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 140 00000004:00080000:2.0:1788813149.006922:0:6497:0:(mdd_object.c:4199:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00080000:1.0:1788813149.006964:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788813149.007001:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788813149.007032:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70338e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813149.007070:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70338e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813149.007091:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70338e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813149.007100:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70338e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813149.007106:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70338e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813149.007112:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70338e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813149.007135:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788813149.007191:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a612cd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:11370:x1875706301712128:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 457us (848us total) trans 4294967410 rc 0/0 00010000:00010000:0.0:1788813149.007195:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788813149.007200:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 32 00010000:00010000:0.0:1788813149.007205:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70338e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788813149.007206:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788813149.007217:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813149.007222:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70338e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.007232:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70338e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.007246:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948a584a3f00) 00010000:00010000:0.0:1788813149.007250:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788813149.007256:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70338e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.007262:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70338e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.007275:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813149.007277:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813149.007279:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813149.048432:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813149.048552:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301712512 00000100:00100000:3.0:1788813149.048564:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301712512 00000100:00100000:3.0:1788813149.048624:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 141 00000100:00100000:3.0:1788813149.048634:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:11372:x1875706301712512:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813149.048659:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813149.048680:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703395 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729879 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813149.048747:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70339c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813149.048762:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70339c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813149.048795:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70339c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813149.048812:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7033a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813149.048820:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7033a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813149.048827:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7033a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813149.048906:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff7033aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813149.048918:0:12571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072983a expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813149.048926:0:12571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff7033aa lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813149.049007:0:12571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072983a expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813149.049021:0:12571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072983a expref: 22 pid: 6496 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813149.049034:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944079f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313303680:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813149.049142:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942daba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813149.055672:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944079f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313303680:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813149.055705:0:12571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff7033aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813149.058751:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813149.058865:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301712768 00000100:00100000:2.0:1788813149.058876:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301712768 00000100:00100000:2.0:1788813149.058973:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 33 00000100:00100000:2.0:1788813149.058985:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+23:6155:x1875706301712768:12345-192.168.202.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788813149.059246:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:6155:x1875706301712768:12345-192.168.202.13@tcp:35:ldlm_bl.0 Request processed in 263us (505us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788813149.059254:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 33 00000100:00100000:3.0:1788813149.069118:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813149.070997:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301712896 00000100:00100000:1.0:1788813149.071013:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301712896 00010000:00010000:1.0:1788813149.071069:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072983a expref: 24 pid: 6496 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813149.071130:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 78 00000100:00100000:1.0:1788813149.071140:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944079c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:2397:x1875706301712896:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813149.071185:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813149.071192:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072983a expref: 24 pid: 6496 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813149.071206:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072983a expref: 24 pid: 6496 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813149.071230:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7032b5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072983a expref: 24 pid: 6496 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813149.071246:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813149.071251:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff7033aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813149.071261:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff7033aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813149.071269:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff7033aa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813149.071301:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813149.071368:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944079c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+23:2397:x1875706301712896:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 229us (2259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813149.071376:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 78 00010000:00010000:0.0:1788813149.073965:0:12571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff7033aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.073981:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff7033aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813149.074049:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788813149.074053:0:12571:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813149.074082:0:12571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff7033aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074098:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff7033aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074108:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70339c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074114:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70339c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074122:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70339c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074128:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813149.074132:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70339c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074163:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70339c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074181:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:0.0:1788813149.074183:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813149.074189:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70339c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074195:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70339c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074213:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7033a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074219:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7033a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074225:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7033a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074230:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813149.074232:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7033a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074238:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7033a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074244:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948a764be600) 00010000:00010000:0.0:1788813149.074247:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813149.074250:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7033a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074265:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7033a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074325:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703395 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729879 expref: 23 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074343:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff7033aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729879 expref: 22 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813149.074349:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:0.0:1788813149.074351:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813149.074354:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657c00, rc 0) 00000100:00100000:0.0:1788813149.074430:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:11372:x1875706301712512:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 25796us (26005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813149.074438:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 141 00000040:00080000:3.0:1788813149.157295:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788813149.158548:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813149.568298:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813149.568330:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301713152 00000100:00100000:3.0:1788813149.568331:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813149.568340:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301713152 00000100:00100000:3.0:1788813149.568370:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813149.568395:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813149.568404:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301713408 00000100:00100000:0.0:1788813149.568407:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301713408 00000100:00100000:0.0:1788813149.568446:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 262 00000100:00100000:0.0:1788813149.568456:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894407aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301713152:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813149.568528:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894407aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301713152:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 74us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813149.568535:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 262 00000100:00100000:0.0:1788813149.568553:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 263 00000100:00100000:0.0:1788813149.568560:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894407bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301713408:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813149.568716:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894407bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301713408:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 155us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813149.568723:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 263 00000100:00080000:0.0:1788813149.568740:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813149.568744:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813149.568754:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301713024 00000100:00100000:0.0:1788813149.568758:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301713024 00000100:00100000:0.0:1788813149.568889:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 371 00000100:00100000:0.0:1788813149.568896:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2399:x1875706301713024:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813149.568924:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2399:x1875706301713024:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813149.568929:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 371 00000100:00100000:2.0:1788813149.572415:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813149.572565:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301713536 00000100:00100000:2.0:1788813149.572574:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301713536 00000100:00100000:2.0:1788813149.572648:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 264 00000100:00100000:2.0:1788813149.572657:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eaeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301713536:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813149.572725:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eaeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301713536:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 69us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813149.572732:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 264 00000100:00080000:2.0:1788813149.572754:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788813149.573079:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301713280 00000100:00100000:2.0:1788813149.573085:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301713280 00000100:00100000:2.0:1788813149.573122:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 101 00000100:00100000:2.0:1788813149.573130:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301713280:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813149.573167:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301713280:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 37us (4770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813149.573173:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 101 00000100:00080000:2.0:1788813149.573222:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788813149.958906:0:14228:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813149.958917:0:14228:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813149.958977:0:14228:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788813149.958984:0:14228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788813150.052105:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813150.052117:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813150.052143:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788813150.052153:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813150.052301:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875706313303808:192.168.202.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788813150.052395:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788813150.055735:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943525f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875706313303808:192.168.202.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788813150.056140:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813150.056373:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301713664 00000100:00100000:1.0:1788813150.056381:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301713664 00000100:00100000:1.0:1788813150.056439:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 142 00000100:00100000:1.0:1788813150.056450:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:11384:x1875706301713664:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788813150.056501:0:6494:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788813150.056618:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:11384:x1875706301713664:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 Request processed in 169us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813150.056625:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 142 00000100:00100000:1.0:1788813150.063705:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813150.063782:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301713920 00000100:00100000:2.0:1788813150.063793:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301713920 00000100:00100000:2.0:1788813150.063865:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 143 00000100:00100000:2.0:1788813150.063877:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:11384:x1875706301713920:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813150.063897:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813150.063917:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7033b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729880 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813150.064100:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7033b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813150.064116:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7033b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813150.064128:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7033b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813150.064138:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788813150.064440:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7033b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729880 expref: 25 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813150.064457:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7033b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729880 expref: 24 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813150.064466:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:2.0:1788813150.064469:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813150.064473:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08800, rc 0) 00000100:00100000:2.0:1788813150.064537:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:11384:x1875706301713920:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 663us (839us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788813150.064554:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 143 00000100:00100000:2.0:1788813150.069675:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813150.069758:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301714176 00000100:00100000:3.0:1788813150.069769:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301714176 00000100:00100000:3.0:1788813150.069845:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 144 00000100:00100000:3.0:1788813150.069855:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:11384:x1875706301714176:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788813150.069960:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7033c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813150.069977:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7033c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813150.069987:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7033c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813150.070149:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7033c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813150.070157:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7033c6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813150.070163:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7033c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813150.070170:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813150.070187:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7033c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813150.070194:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7033c6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813150.070207:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813150.070484:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788813150.070491:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7033c6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813150.070498:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7033c6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813150.070654:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:11384:x1875706301714176:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 799us (989us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788813150.070663:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 144 00000100:00100000:1.0:1788813150.073377:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813150.073571:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301714304 00000100:00100000:3.0:1788813150.073581:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301714304 00000100:00100000:3.0:1788813150.073653:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:3.0:1788813150.073665:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:2397:x1875706301714304:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813150.073683:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813150.073706:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7033b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729880 expref: 25 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813150.073724:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813150.073728:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813150.073800:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:2397:x1875706301714304:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 137us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813150.073821:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:3.0:1788813150.076120:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813150.076418:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301714560 00000100:00100000:0.0:1788813150.076428:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301714560 00000100:00100000:0.0:1788813150.076484:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 34 00000100:00100000:0.0:1788813150.076495:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:11384:x1875706301714560:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788813150.076714:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:11384:x1875706301714560:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 220us (604us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788813150.076722:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 34 00000040:00080000:2.0:1788813150.077513:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813150.077519:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813150.078326:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788813150.078339:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788813150.184652:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813150.565077:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788813150.565101:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313303936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813150.565168:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813150.565251:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313303936 00000100:00100000:2.0:1788813150.565259:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313303936 00000100:00100000:2.0:1788813150.565310:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788813150.565319:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1875706313303936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813150.565346:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788813150.565390:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1875706313303936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813150.565398:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1788813150.565419:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813150.565456:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313303936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813150.566239:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313304192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813150.566315:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813150.566354:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313304192 00000100:00100000:3.0:1788813150.566359:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313304192 00000100:00100000:3.0:1788813150.566486:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788813150.566495:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313304192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788813150.566522:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788813150.566580:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313304192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813150.566586:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788813150.566621:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313304192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813150.567050:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313304320:0@lo:400:kworker.0 00000100:00100000:0.0:1788813150.567404:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813150.567437:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313304832:0@lo:400:kworker.0 00000100:00100000:0.0:1788813150.567466:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813150.567487:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313305344:0@lo:400:kworker.0 00000100:00100000:0.0:1788813150.567520:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813150.567553:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788813150.567559:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313304704:0@lo:400:kworker.0 00000100:00100000:0.0:1788813150.567583:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813150.567615:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313305216:0@lo:400:kworker.0 00000100:00100000:1.0:1788813150.567764:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313304448:0@lo:400:kworker.0 00000100:00100000:1.0:1788813150.567796:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813150.567816:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313304960:0@lo:400:kworker.0 00000100:00100000:1.0:1788813150.567857:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813150.567874:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1875706313305472:0@lo:400:kworker.0 00000100:00100000:1.0:1788813150.567895:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813150.567914:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788813150.567920:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313304064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813150.567995:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813150.568018:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313304576:0@lo:400:kworker.0 00000100:00100000:1.0:1788813150.568042:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813150.568054:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313305088:0@lo:400:kworker.0 00000100:00100000:1.0:1788813150.568098:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313304832 00000100:00100000:1.0:1788813150.568106:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313304832 00000100:00100000:1.0:1788813150.568147:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313305344 00000100:00100000:1.0:1788813150.568150:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313305344 00000100:00100000:1.0:1788813150.568165:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313304448 00000100:00100000:1.0:1788813150.568167:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313304448 00000100:00100000:1.0:1788813150.568177:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313304960 00000100:00100000:1.0:1788813150.568179:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313304960 00000100:00100000:1.0:1788813150.568201:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313305472 00000100:00100000:1.0:1788813150.568205:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313305472 00000100:00100000:1.0:1788813150.568233:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313304576 00000100:00100000:1.0:1788813150.568237:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313304576 00000100:00100000:1.0:1788813150.568250:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788813150.568257:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313304832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813150.568301:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313304832:12345-0@lo:400:kworker.0 Request processed in 44us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813150.568308:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788813150.568324:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788813150.568330:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313305344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813150.568356:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313305344:12345-0@lo:400:kworker.0 Request processed in 26us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813150.568362:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788813150.568372:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788813150.568378:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313304448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813150.568409:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313304448:12345-0@lo:400:kworker.0 Request processed in 32us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813150.568415:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788813150.568426:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788813150.568432:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313304960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813150.568456:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313304960:12345-0@lo:400:kworker.0 Request processed in 26us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813150.568462:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788813150.568474:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788813150.568481:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875706313305472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813150.568517:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875706313305472:12345-0@lo:400:kworker.0 Request processed in 37us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813150.568523:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788813150.568535:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788813150.568540:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313304576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813150.568565:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313304576:12345-0@lo:400:kworker.0 Request processed in 25us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813150.568570:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788813150.570331:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813150.570401:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313304832:0@lo:400:kworker.0 00000100:00100000:0.0:1788813150.570415:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313305344:0@lo:400:kworker.0 00000100:00100000:0.0:1788813150.570447:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313304704 00000100:00100000:0.0:1788813150.570453:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313304704 00000100:00100000:0.0:1788813150.570491:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788813150.570499:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313304704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813150.570560:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313304704:12345-0@lo:400:kworker.0 Request processed in 61us (2976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813150.570566:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788813150.570593:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813150.570619:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313305600:0@lo:400:kworker.0 00000100:00100000:3.0:1788813150.570953:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313304320 00000100:00100000:3.0:1788813150.570959:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313304320 00000100:00100000:3.0:1788813150.570992:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788813150.570999:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313304320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813150.571035:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3626:x1875706313304320:12345-0@lo:400:kworker.0 Request processed in 36us (3631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813150.571040:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788813150.571091:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313304064 00000100:00100000:3.0:1788813150.571095:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313304064 00000100:00100000:3.0:1788813150.571124:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788813150.571130:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944051180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313304064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788813150.571144:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788813150.571195:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944051180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313304064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (3200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813150.571201:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788813150.571233:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313305216 00000100:00100000:3.0:1788813150.571237:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313305216 00000100:00100000:3.0:1788813150.571263:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313305088 00000100:00100000:3.0:1788813150.571265:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313305088 00000100:00100000:3.0:1788813150.571285:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788813150.571291:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3626:x1875706313305216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813150.571321:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3626:x1875706313305216:12345-0@lo:400:kworker.0 Request processed in 30us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813150.571326:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788813150.571337:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788813150.571343:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313305088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813150.571366:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313305088:12345-0@lo:400:kworker.0 Request processed in 24us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813150.571371:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788813150.571425:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313304704:0@lo:400:kworker.0 00000100:00100000:3.0:1788813150.571437:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313305216:0@lo:400:kworker.0 00000100:00100000:3.0:1788813150.571445:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313304320:0@lo:400:kworker.0 00000100:00100000:0.0:1788813150.571650:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813150.571687:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313304448:0@lo:400:kworker.0 00010000:00080000:0.0:1788813150.571702:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948944024e00 x1875706313304960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813150.571711:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313304960:0@lo:400:kworker.0 00010000:00080000:0.0:1788813150.571723:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489436e7b80 x1875706313305472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813150.571745:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1875706313305472:0@lo:400:kworker.0 00000100:00100000:0.0:1788813150.571773:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313304064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813150.571783:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313304576:0@lo:400:kworker.0 00000100:00100000:0.0:1788813150.571793:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313305088:0@lo:400:kworker.0 00000100:00100000:2.0:1788813150.573006:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313305600 00000100:00100000:2.0:1788813150.573015:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313305600 00000100:00100000:2.0:1788813150.573078:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788813150.573088:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313305600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813150.573158:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313305600:12345-0@lo:400:kworker.0 Request processed in 71us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813150.573164:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1788813150.573198:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813150.573202:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813150.573205:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788813150.573208:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813150.577652:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313305600:0@lo:400:kworker.0 00010000:00010000:0.0:1788813151.204155:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813152.046359:0:14280:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813152.046368:0:14280:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813152.046408:0:14280:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788813152.046418:0:14280:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788813152.229600:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813152.247544:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813152.247575:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301714816 00000100:00100000:3.0:1788813152.247584:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301714816 00000100:00100000:3.0:1788813152.247644:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 145 00000100:00100000:3.0:1788813152.247654:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:11405:x1875706301714816:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813152.247678:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813152.247704:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7033cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729887 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813152.247834:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff7033d4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813152.247847:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff7033d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813152.247872:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff7033d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813152.247882:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788813152.247995:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7033cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729887 expref: 28 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813152.248010:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff7033d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729887 expref: 27 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813152.248018:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:3.0:1788813152.248022:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788813152.248025:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656000, rc 0) 00000100:00100000:3.0:1788813152.248092:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:11405:x1875706301714816:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 439us (555us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788813152.248099:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 145 00000100:00080000:2.0:1788813152.249181:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813152.261348:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813152.262111:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301714944 00000100:00100000:2.0:1788813152.262123:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301714944 00000100:00100000:2.0:1788813152.262181:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 146 00000100:00100000:2.0:1788813152.262192:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:11405:x1875706301714944:12345-192.168.202.13@tcp:54:lfs.0 00010000:00010000:2.0:1788813152.262262:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7033e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813152.262279:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7033e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813152.262290:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7033e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813152.262324:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7033e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813152.262330:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7033e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813152.262335:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7033e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813152.262340:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813152.262344:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7033e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813152.262364:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7033e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813152.262376:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:2.0:1788813152.262379:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813152.262383:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7033e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813152.262389:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7033e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813152.262461:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:11405:x1875706301714944:12345-192.168.202.13@tcp:54:lfs.0 Request processed in 270us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813152.262469:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 146 00000100:00100000:3.0:1788813152.413746:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813152.414293:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301715072 00000100:00100000:0.0:1788813152.414304:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301715072 00000100:00100000:0.0:1788813152.414387:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 54 00000100:00100000:0.0:1788813152.414398:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2396:x1875706301715072:12345-192.168.202.13@tcp:101:cat.0 00010000:00010000:0.0:1788813152.414414:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813152.414436:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f3530a7/0xf32533d6ff7033e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072988e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813152.414461:0:8404:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f1f5c, atime: 0x6a9f1f5c, ctime: 0x6a9f1f5c, blocks: 0x8 00010000:00010000:0.0:1788813152.414481:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=305s v=(0 0) 00010000:00010000:0.0:1788813152.414485:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813152.414495:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f3530a7/0xf32533d6ff7033e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072988e expref: 7 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813152.414514:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006f3530a7/0xf32533d6ff7033e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072988e expref: 7 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813152.414540:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166ec00, rc 0) 00000100:00100000:0.0:1788813152.414601:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301715072:12345-192.168.202.13@tcp:101:cat.0 Request processed in 204us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813152.414607:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 54 00000100:00080000:2.0:1788813152.415371:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813152.419554:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813152.419815:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301715200 00000100:00100000:0.0:1788813152.419825:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301715200 00002000:00100000:0.0:1788813152.419892:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff948944079500 x1875706301715200/t0(0) o3->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:723/0 lens 488/0 e 0 to 0 dl 1788813163 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813152.419904:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948944079500 with x1875706301715200 ext(0->4095) 00002000:00010000:0.0:1788813152.419911:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948944079500 00000100:00100000:0.0:1788813152.420061:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:0.0:1788813152.420072:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2398:x1875706301715200:12345-192.168.202.13@tcp:3:cat.0 00000100:00100000:0.0:1788813152.420490:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2398:x1875706301715200:12345-192.168.202.13@tcp:3:cat.0 Request processed in 418us (944us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788813152.420498:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3 00002000:00100000:0.0:1788813152.420506:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff948944079500 x1875706301715200/t0(0) o3->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:723/0 lens 488/4536 e 0 to 0 dl 1788813163 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813152.420515:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948944079500 with x1875706301715200 ext(0->4095) 00002000:00010000:0.0:1788813152.420519:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948944079500 00000100:00100000:3.0:1788813152.612210:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313305728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813152.612285:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813152.612377:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313305728 00000100:00100000:2.0:1788813152.612385:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313305728 00000100:00100000:2.0:1788813152.612457:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788813152.612468:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313305728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788813152.612497:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813152.612545:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313305728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813152.612551:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788813152.612648:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313305728:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788813152.612778:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813152.612872:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313305856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813152.612900:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813152.612992:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313305856 00000100:00100000:3.0:1788813152.612997:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313305856 00000100:00100000:3.0:1788813152.613030:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788813152.613037:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1875706313305856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813152.613058:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788813152.613094:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813152.629107:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1875706313305856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 16060us (16195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813152.629203:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788813152.631155:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313305856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813153.125891:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313305984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813153.126097:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813153.128472:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313305984 00000100:00100000:0.0:1788813153.128487:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313305984 00000100:00100000:0.0:1788813153.143320:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788813153.143342:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313305984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813153.143396:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788813153.143482:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313305984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (17385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813153.143488:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788813153.148177:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313305984:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788813153.252455:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788813154.153385:0:8399:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:0.0:1788813154.276363:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813154.688705:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813154.688751:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813154.688807:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813154.688846:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813154.688868:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813154.688890:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813154.688912:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813154.688968:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301715584 00000100:00100000:3.0:1788813154.688979:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301715584 00000100:00100000:3.0:1788813154.689049:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301716096 00000100:00100000:3.0:1788813154.689063:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301716096 00000100:00100000:3.0:1788813154.689081:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 271 00000100:00100000:3.0:1788813154.689091:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301715584:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813154.689162:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301715584:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 72us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813154.689170:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 271 00000100:00100000:3.0:1788813154.689185:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301715456 00000100:00100000:3.0:1788813154.689189:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301715456 00000100:00100000:3.0:1788813154.689214:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301715968 00000100:00100000:3.0:1788813154.689217:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301715968 00000100:00100000:3.0:1788813154.689230:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 272 00000100:00100000:3.0:1788813154.689235:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301716096:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813154.689262:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301716096:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813154.689267:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 272 00000100:00100000:3.0:1788813154.689277:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 273 00000100:00100000:3.0:1788813154.689282:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:2398:x1875706301715456:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813154.689302:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:2398:x1875706301715456:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 21us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813154.689307:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 273 00000100:00100000:3.0:1788813154.689317:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 274 00000100:00100000:3.0:1788813154.689322:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301715968:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813154.689338:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2398:x1875706301715968:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 16us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813154.689343:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 274 00000100:00100000:3.0:1788813154.689365:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301715840 00000100:00100000:3.0:1788813154.689368:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301715840 00000100:00100000:3.0:1788813154.689394:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301715712 00000100:00100000:3.0:1788813154.689397:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301715712 00000100:00100000:1.0:1788813154.689569:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 105 00000100:00100000:1.0:1788813154.689578:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2398:x1875706301715840:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813154.689607:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2398:x1875706301715840:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 32us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813154.689613:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 105 00000100:00100000:0.0:1788813154.689706:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301715328 00000100:00100000:0.0:1788813154.689711:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301715328 00000100:00100000:0.0:1788813154.689742:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 373 00000100:00100000:0.0:1788813154.689749:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301715328:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813154.689774:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301715328:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813154.689781:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 373 00000100:00100000:3.0:1788813154.689958:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 106 00000100:00100000:3.0:1788813154.689966:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a766b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301715712:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813154.689993:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a766b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2398:x1875706301715712:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 28us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813154.690009:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 106 00000100:00080000:1.0:1788813154.692277:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813154.692287:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813154.692291:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813154.692294:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:3.0:1788813155.175702:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1788813155.175717:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1788813155.176125:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1788813155.176159:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff948943057840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788813155.176164:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948a47e77e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff948943057240 00000020:00080000:2.0:1788813155.176167:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948a47e77200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff948942059800 00000020:00080000:2.0:1788813155.176193:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788813155.176251:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788813155.176321:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1788813155.176453:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703364 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813155.176464:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703364 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813155.176472:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703364 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813155.176477:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813155.176482:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703364 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813155.176489:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703364 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813155.176506:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948a584a3f00) 00010000:00010000:3.0:1788813155.176509:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813155.176514:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703364 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813155.176520:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703364 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813155.300360:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813155.684123:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813155.684151:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313306112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813155.684223:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813155.684401:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313306112 00000100:00100000:0.0:1788813155.684537:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313306240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813155.684567:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813155.684589:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313306752:0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.684592:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313306112 00000100:00100000:0.0:1788813155.684619:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813155.684641:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313307264:0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.684652:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313306240 00000100:00100000:3.0:1788813155.684664:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313306240 00000100:00100000:0.0:1788813155.684669:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813155.684692:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313307776:0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.684695:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788813155.684708:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313306112:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813155.684719:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788813155.684738:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788813155.684741:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788813155.684748:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313306368:0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.684796:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313306112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813155.684801:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813155.684810:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788813155.684835:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788813155.684841:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313306880:0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.684844:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313306240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788813155.684860:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788813155.684876:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813155.685629:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313306240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 785us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813155.685637:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1788813155.685662:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813155.690177:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313307392:0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.690269:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813155.690330:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313306240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813155.690352:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813155.690366:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313307904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813155.690393:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813155.690500:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313307264 00000100:00100000:3.0:1788813155.690508:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313307264 00000100:00100000:3.0:1788813155.690557:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313307776 00000100:00100000:3.0:1788813155.690560:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313307776 00000100:00100000:3.0:1788813155.690581:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313307392 00000100:00100000:3.0:1788813155.690584:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313307392 00000100:00100000:3.0:1788813155.690598:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788813155.690605:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313307264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.690666:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313307264:12345-0@lo:400:kworker.0 Request processed in 61us (5999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813155.690673:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788813155.690689:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788813155.690694:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313307776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.690739:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313307776:12345-0@lo:400:kworker.0 Request processed in 45us (6020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813155.690745:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788813155.690757:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788813155.690762:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313307392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.690787:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313307392:12345-0@lo:400:kworker.0 Request processed in 25us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813155.690792:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1788813155.690808:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813155.692913:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788813155.692925:0:3625:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1788813155.692965:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff948a764c8a80, transno 4294967305 00000100:00100000:0.0:1788813155.692986:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313307392:0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.693001:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313307264:0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.693025:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313307776:0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.693137:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313306496:0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.693185:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813155.693205:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313307008:0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.693225:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813155.693243:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313307520:0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.693291:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813155.693313:0:3627:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1788813155.693328:0:3627:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff948a6a89e300, transno 4294967311 00000004:00080000:0.0:1788813155.693349:0:3627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1788813155.693374:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313306112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813155.693391:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788813155.693398:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313306624:0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.693690:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313306752 00000100:00100000:3.0:1788813155.693715:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313306752 00000100:00100000:3.0:1788813155.693759:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313306496 00000100:00100000:3.0:1788813155.693763:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313306496 00000100:00100000:3.0:1788813155.693775:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313307008 00000100:00100000:3.0:1788813155.693778:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313307008 00000100:00100000:3.0:1788813155.693798:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313307520 00000100:00100000:3.0:1788813155.693801:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313307520 00000100:00100000:3.0:1788813155.693818:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788813155.693827:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313306752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.693891:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313306752:12345-0@lo:400:kworker.0 Request processed in 65us (9273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813155.693898:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788813155.693913:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788813155.693919:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313306496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.693963:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313306496:12345-0@lo:400:kworker.0 Request processed in 44us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813155.693970:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788813155.693990:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788813155.693997:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313307008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.694273:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813155.694573:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313307008:12345-0@lo:400:kworker.0 Request processed in 44us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813155.694584:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788813155.694603:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788813155.694612:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313307520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.694728:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313307520:12345-0@lo:400:kworker.0 Request processed in 117us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813155.694735:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:3.0:1788813155.694764:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813155.694798:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313306752:0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.696130:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313306368 00000100:00100000:3.0:1788813155.696140:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313306368 00000100:00100000:3.0:1788813155.696192:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788813155.696200:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3625:x1875706313306368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.696265:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3625:x1875706313306368:12345-0@lo:400:kworker.0 Request processed in 66us (11467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813155.696273:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788813155.696340:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313306368:0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.705277:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313307136:0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.705340:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813155.705380:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313307136 00000100:00100000:0.0:1788813155.705388:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313307136 00000100:00100000:0.0:1788813155.705457:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788813155.705467:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313307136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.705515:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313307136:12345-0@lo:400:kworker.0 Request processed in 51us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813155.705522:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:0.0:1788813155.705645:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788813155.705822:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489436e5f80 x1875706313307136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813155.705837:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313307136:0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.705844:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1875706313307648:0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.705869:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813155.705891:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313307648 00000100:00100000:0.0:1788813155.705895:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313307648 00000100:00100000:0.0:1788813155.705954:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788813155.705961:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875706313307648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.705990:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875706313307648:12345-0@lo:400:kworker.0 Request processed in 31us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813155.706020:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:0.0:1788813155.706035:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788813155.706175:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489436e5500 x1875706313307648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813155.706185:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1875706313307648:0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.706199:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313306496:0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.706210:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313307008:0@lo:400:kworker.0 00000100:00100000:0.0:1788813155.706220:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313307520:0@lo:400:kworker.0 00000100:00100000:2.0:1788813155.708392:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313306880 00000100:00100000:1.0:1788813155.708557:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313307904 00000100:00100000:1.0:1788813155.708563:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313307904 00000100:00100000:1.0:1788813155.708621:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313306624 00000100:00100000:1.0:1788813155.708625:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313306624 00000100:00100000:1.0:1788813155.708641:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788813155.708649:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1875706313307904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788813155.708687:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788813155.708848:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1875706313307904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 199us (18454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813155.708855:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788813155.708871:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788813155.708878:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313306624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813155.708916:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313306624:12345-0@lo:400:kworker.0 Request processed in 39us (14644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813155.708922:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788813155.709133:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313307904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813155.709625:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313306624:0@lo:400:kworker.0 00000100:00100000:2.0:1788813155.710279:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313306880 00000100:00100000:3.0:1788813155.719356:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788813155.719370:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313306880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.719474:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313306880:12345-0@lo:400:kworker.0 Request processed in 105us (34597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813155.719482:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788813155.719543:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313306880:0@lo:400:kworker.0 00010000:00010000:0.0:1788813156.324348:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813157.349113:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813157.732358:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813157.732381:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313308032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813157.732453:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813157.732551:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313308032 00000100:00100000:1.0:1788813157.732560:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313308032 00000100:00100000:1.0:1788813157.732630:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788813157.732640:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313308032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788813157.732671:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813157.732716:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313308032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813157.732723:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788813157.732772:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313308032:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788813157.732897:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813157.733015:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813157.733087:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313308160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813157.733118:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813157.733234:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313308160 00000100:00100000:1.0:1788813157.733249:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313308160 00000100:00100000:1.0:1788813157.733288:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788813157.733294:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313308160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813157.733305:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813157.733336:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313308160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813157.733342:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788813157.733366:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313308160:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788813157.733425:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813158.244247:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813158.244269:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313308288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813158.244368:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813158.244501:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313308288 00000100:00100000:3.0:1788813158.244509:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313308288 00000100:00100000:3.0:1788813158.244573:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788813158.244583:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313308288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788813158.244616:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788813158.244663:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313308288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813158.244670:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788813158.244716:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313308288:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788813158.373009:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813158.688832:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813158.688956:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301716224 00000100:00100000:0.0:1788813158.688969:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301716224 00000100:00100000:0.0:1788813158.689104:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 147 00000100:00100000:0.0:1788813158.689115:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+13:11058:x1875706301716224:12345-192.168.202.13@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788813158.689256:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+13:11058:x1875706301716224:12345-192.168.202.13@tcp:60:lhsmtool_posix.0 Request processed in 143us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813158.689262:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 147 00000100:00080000:3.0:1788813158.691453:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813158.704023:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813158.706699:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301716352 00000100:00100000:0.0:1788813158.706715:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301716352 00000100:00100000:0.0:1788813158.706855:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 148 00000100:00100000:0.0:1788813158.706868:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:11058:x1875706301716352:12345-192.168.202.13@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788813158.707359:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:11058:x1875706301716352:12345-192.168.202.13@tcp:60:lhsmtool_posix.0 Request processed in 493us (3428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813158.707368:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 148 00000100:00080000:3.0:1788813158.710269:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788813158.715591:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813158.715784:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301716608 00000100:00100000:2.0:1788813158.715794:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301716608 00000100:00100000:2.0:1788813158.715851:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 35 00000100:00100000:2.0:1788813158.715868:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+13:11058:x1875706301716608:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788813158.716311:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:11058:x1875706301716608:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 450us (727us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788813158.716318:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 35 00000040:00080000:2.0:1788813159.397628:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788813159.398751:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813159.811884:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813159.811982:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813159.812023:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813159.812053:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813159.812068:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301716736 00000100:00100000:0.0:1788813159.812079:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301716736 00000100:00100000:2.0:1788813159.812086:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813159.812106:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813159.812127:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813159.812127:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 375 00000100:00100000:0.0:1788813159.812136:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2399:x1875706301716736:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813159.812164:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301716992 00000100:00100000:2.0:1788813159.812168:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301716992 00000100:00100000:2.0:1788813159.812194:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301717504 00000100:00100000:2.0:1788813159.812196:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301717504 00000100:00100000:0.0:1788813159.812204:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2399:x1875706301716736:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 69us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813159.812211:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 375 00000100:00100000:2.0:1788813159.812213:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301716864 00000100:00100000:2.0:1788813159.812215:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301716864 00000100:00100000:2.0:1788813159.812224:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301717376 00000100:00100000:2.0:1788813159.812226:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301717376 00000100:00100000:2.0:1788813159.812239:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 281 00000100:00100000:2.0:1788813159.812245:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301716992:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813159.812273:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301716992:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813159.812279:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 281 00000100:00100000:2.0:1788813159.812291:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 282 00000100:00100000:2.0:1788813159.812296:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301717504:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813159.812318:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301717504:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 22us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813159.812324:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 282 00000100:00100000:2.0:1788813159.812334:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 283 00000100:00100000:2.0:1788813159.812340:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:2399:x1875706301716864:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813159.812368:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 284 00000100:00100000:0.0:1788813159.812376:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301717376:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813159.812394:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:2399:x1875706301716864:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 54us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813159.812397:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2399:x1875706301717376:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 23us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813159.812401:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 283 00000100:00100000:0.0:1788813159.812404:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 284 00000100:00100000:3.0:1788813159.813575:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301717248 00000100:00100000:3.0:1788813159.813585:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301717248 00000100:00100000:3.0:1788813159.813688:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301717120 00000100:00100000:3.0:1788813159.813692:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301717120 00000100:00100000:3.0:1788813159.813727:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 110 00000100:00100000:3.0:1788813159.813736:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2399:x1875706301717248:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813159.813795:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2399:x1875706301717248:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 60us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813159.813813:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 110 00000100:00100000:3.0:1788813159.813828:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 111 00000100:00100000:3.0:1788813159.813834:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301717120:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813159.813859:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2399:x1875706301717120:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 25us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813159.813864:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 111 00000100:00080000:3.0:1788813159.813893:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813159.813897:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813159.813900:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813159.813902:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788813160.356230:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788813160.356238:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813160.356337:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:3.0:1788813160.356354:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788813160.357896:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1788813160.357910:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788813160.358043:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788813160.358054:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788813160.421169:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788813160.720533:0:14477:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:32:39 (1788813159) 00000100:00100000:2.0:1788813160.804202:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313308928:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.804285:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813160.804336:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489432c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313309440:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.804359:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813160.804378:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313309952:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.804399:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813160.804451:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788813160.804458:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313308544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813160.804504:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813160.804524:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489434e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313309056:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.804546:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813160.804562:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313309568:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.804583:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813160.804599:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313310080:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.804619:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813160.804645:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313308672:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.804672:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813160.804693:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a64340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313309184:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.804712:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813160.804729:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313309696:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.804749:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813160.804765:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313310208:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.804785:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813160.804804:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788813160.804809:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313308800:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.804840:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813160.804858:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313309312:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.804877:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813160.804892:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313309824:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.804910:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813160.804920:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313308416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813160.804972:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813160.805004:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313309440 00000100:00100000:2.0:1788813160.805011:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313309440 00000100:00100000:2.0:1788813160.805054:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313309952 00000100:00100000:2.0:1788813160.805057:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313309952 00000100:00100000:2.0:1788813160.805070:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313309056 00000100:00100000:2.0:1788813160.805072:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313309056 00000100:00100000:2.0:1788813160.805083:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313308800 00000100:00100000:2.0:1788813160.805085:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313308800 00000100:00100000:2.0:1788813160.805094:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313309312 00000100:00100000:2.0:1788813160.805096:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313309312 00000100:00100000:2.0:1788813160.805108:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313309824 00000100:00100000:2.0:1788813160.805110:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313309824 00000100:00100000:2.0:1788813160.805124:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788813160.805131:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313309440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.805183:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313309440:12345-0@lo:400:kworker.0 Request processed in 51us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.805189:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788813160.805209:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788813160.805215:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313309952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.805241:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313309952:12345-0@lo:400:kworker.0 Request processed in 26us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.805254:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788813160.805266:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788813160.805271:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313309056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.805298:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313309056:12345-0@lo:400:kworker.0 Request processed in 27us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.805303:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788813160.805314:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788813160.805319:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313308800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.805347:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313308800:12345-0@lo:400:kworker.0 Request processed in 28us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.805353:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788813160.805364:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788813160.805370:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894407b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313309312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.805394:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894407b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313309312:12345-0@lo:400:kworker.0 Request processed in 25us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.805400:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788813160.805412:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788813160.805417:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894407b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313309824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.805443:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894407b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313309824:12345-0@lo:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.805449:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788813160.805469:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313308544 00000100:00100000:2.0:1788813160.805473:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313308544 00000100:00100000:2.0:1788813160.805496:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313308416 00000100:00100000:2.0:1788813160.805499:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313308416 00000100:00100000:2.0:1788813160.805523:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788813160.805529:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313308544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813160.805551:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788813160.805582:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313308544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.805588:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788813160.805600:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788813160.805606:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313308416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813160.805616:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788813160.805640:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313308416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.805645:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788813160.805665:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313309568 00000100:00100000:2.0:1788813160.805669:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313309568 00000100:00100000:2.0:1788813160.805693:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313310080 00000100:00100000:2.0:1788813160.805696:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313310080 00000100:00100000:2.0:1788813160.805705:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313309696 00000100:00100000:2.0:1788813160.805707:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313309696 00000100:00100000:2.0:1788813160.805717:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313310208 00000100:00100000:2.0:1788813160.805719:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313310208 00000100:00100000:2.0:1788813160.805729:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788813160.805734:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313309568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.805764:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313309568:12345-0@lo:400:kworker.0 Request processed in 29us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.805770:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788813160.805781:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788813160.805788:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313310080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.805824:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313310080:12345-0@lo:400:kworker.0 Request processed in 37us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.805831:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788813160.805843:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788813160.805849:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313309696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.805873:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313309696:12345-0@lo:400:kworker.0 Request processed in 25us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.805879:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788813160.805889:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788813160.805895:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313310208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.805918:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313310208:12345-0@lo:400:kworker.0 Request processed in 24us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.805924:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788813160.805960:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313308672 00000100:00100000:2.0:1788813160.805975:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313308672 00000100:00100000:2.0:1788813160.806002:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788813160.806008:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313308672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.806037:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313308672:12345-0@lo:400:kworker.0 Request processed in 29us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.806043:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788813160.806069:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313308928 00000100:00100000:2.0:1788813160.806073:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313308928 00000100:00100000:2.0:1788813160.806093:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313309184 00000100:00100000:2.0:1788813160.806095:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313309184 00000100:00100000:2.0:1788813160.806107:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788813160.806112:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313308928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.806153:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313308928:12345-0@lo:400:kworker.0 Request processed in 41us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.806160:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788813160.806172:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788813160.806178:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a89e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313309184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.806206:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a89e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313309184:12345-0@lo:400:kworker.0 Request processed in 28us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.806212:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788813160.806569:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313308800:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.806581:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313309312:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.806591:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313309824:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.806605:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313308416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813160.806613:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313308672:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.806622:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a64340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313309184:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.806630:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313309696:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.806639:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313310208:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.806691:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313308544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813160.806701:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313309056:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.806710:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313309568:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.806718:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313310080:0@lo:400:kworker.0 00000100:00100000:2.0:1788813160.806736:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489434e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313308928:0@lo:400:kworker.0 00010000:00080000:2.0:1788813160.806749:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489432c5c00 x1875706313309440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813160.806759:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489432c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313309440:0@lo:400:kworker.0 00010000:00080000:2.0:1788813160.806768:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489419b7100 x1875706313309952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813160.806776:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313309952:0@lo:400:kworker.0 00000100:00100000:1.0:1788813160.807244:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313310336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813160.807281:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813160.807313:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313310336 00000100:00100000:1.0:1788813160.807317:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313310336 00000100:00100000:1.0:1788813160.807343:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788813160.807349:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313310336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788813160.807372:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788813160.807444:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313310336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813160.807451:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788813160.807484:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313310336:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788813160.810396:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813160.810405:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813160.810408:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813160.810411:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788813161.444319:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813162.468182:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813162.670915:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813162.671265:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301717760 00000100:00100000:2.0:1788813162.671280:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301717760 00000100:00100000:2.0:1788813162.671383:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 149 00000100:00100000:2.0:1788813162.671396:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+13:12123:x1875706301717760:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813162.671421:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813162.671449:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7033f0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729895 expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.671547:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7033f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.671566:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7033f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.671579:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7033f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.671741:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7033fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.671785:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7033fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.671799:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7033fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788813162.671887:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788813162.677108:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703405 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677130:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703405 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677144:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703405 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813162.677160:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788813162.677375:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7033f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677381:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7033f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677386:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7033f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677389:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813162.677393:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7033f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677398:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7033f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677422:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff948a74b15d00) 00010000:00010000:2.0:1788813162.677424:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813162.677429:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7033f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677433:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7033f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677443:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7033fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677447:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7033fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677453:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7033fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677457:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813162.677460:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7033fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677465:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7033fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677472:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff948943001b00) 00010000:00010000:2.0:1788813162.677474:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813162.677477:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7033fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677482:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7033fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677814:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7033f0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729895 expref: 16 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677825:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703405 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729895 expref: 15 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.677892:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6fe40300) 00010000:00010000:2.0:1788813162.677894:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813162.677896:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09000, rc 0) 00000100:00100000:2.0:1788813162.678029:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:12123:x1875706301717760:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 6635us (7130us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788813162.678037:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 149 00000100:00100000:2.0:1788813162.683440:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813162.683529:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813162.683611:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301718016 00000100:00100000:3.0:1788813162.683629:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301718016 00000100:00100000:3.0:1788813162.683741:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:3.0:1788813162.683753:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50683050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:2397:x1875706301718016:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813162.683775:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813162.683810:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703405 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729895 expref: 15 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.683863:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6fe40300) 00010000:00010000:3.0:1788813162.683871:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813162.684037:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50683050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:2397:x1875706301718016:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 277us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813162.684048:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:0.0:1788813162.685142:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301717888 00000100:00100000:0.0:1788813162.685154:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301717888 00000100:00100000:0.0:1788813162.685223:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 150 00000100:00100000:0.0:1788813162.685234:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:12123:x1875706301717888:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788813162.685627:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:12123:x1875706301717888:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 Request processed in 394us (2192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813162.685636:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 150 00000100:00100000:2.0:1788813162.699599:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813162.701170:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301718144 00000100:00100000:1.0:1788813162.701190:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301718144 00000100:00100000:1.0:1788813162.701390:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 151 00000100:00100000:1.0:1788813162.701405:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:12123:x1875706301718144:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788813162.701552:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:12123:x1875706301718144:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 Request processed in 150us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813162.701560:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 151 00000100:00080000:3.0:1788813162.705808:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788813162.852219:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813162.852251:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313310464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813162.852353:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813162.852575:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313310592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813162.852609:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813162.852977:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313310464 00000100:00100000:3.0:1788813162.852989:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313310464 00000100:00100000:3.0:1788813162.853058:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313310592 00000100:00100000:3.0:1788813162.853062:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313310592 00000100:00100000:3.0:1788813162.853084:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788813162.853095:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313310464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813162.853136:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813162.853189:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313310464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813162.853196:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788813162.853216:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788813162.853222:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313310592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788813162.853233:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813162.853254:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313310592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813162.853260:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1788813162.853285:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813162.854196:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313310592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813162.854532:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313310464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813163.370235:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313310720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813163.370335:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813163.370664:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313310720 00000100:00100000:2.0:1788813163.370675:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313310720 00000100:00100000:2.0:1788813163.370753:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788813163.370764:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489432c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313310720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813163.370811:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788813163.370865:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489432c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313310720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813163.370873:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788813163.370999:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313310720:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788813163.428224:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788813163.428235:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813163.428254:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:3.0:1788813163.428280:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788813163.495059:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788813163.495683:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813164.517969:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813164.929505:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813164.929550:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813164.929572:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813164.929596:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813164.929616:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813164.929649:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813164.929679:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813164.929712:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301718272 00000100:00100000:3.0:1788813164.929725:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301718272 00000100:00100000:3.0:1788813164.929780:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 377 00000100:00100000:3.0:1788813164.929791:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:2397:x1875706301718272:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813164.929866:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:2397:x1875706301718272:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 77us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813164.929874:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 377 00000100:00100000:3.0:1788813164.929908:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301718400 00000100:00100000:3.0:1788813164.929912:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301718400 00000100:00100000:3.0:1788813164.929980:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301718912 00000100:00100000:3.0:1788813164.929984:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301718912 00000100:00100000:3.0:1788813164.929998:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301718528 00000100:00100000:3.0:1788813164.930001:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301718528 00000100:00100000:3.0:1788813164.930015:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301719040 00000100:00100000:3.0:1788813164.930017:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301719040 00000100:00100000:3.0:1788813164.930037:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 291 00000100:00100000:3.0:1788813164.930043:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:2397:x1875706301718400:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813164.930074:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:2397:x1875706301718400:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 31us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813164.930079:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 291 00000100:00100000:3.0:1788813164.930107:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 292 00000100:00100000:3.0:1788813164.930113:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301718912:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813164.930139:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301718912:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 25us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813164.930144:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 292 00000100:00100000:3.0:1788813164.930156:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 293 00000100:00100000:3.0:1788813164.930162:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301718528:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813164.930187:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301718528:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813164.930193:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 293 00000100:00100000:3.0:1788813164.930203:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 294 00000100:00100000:3.0:1788813164.930209:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301719040:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813164.930229:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301719040:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 20us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813164.930235:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 294 00000100:00080000:3.0:1788813164.930255:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813164.930260:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813164.930451:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301718656 00000100:00100000:2.0:1788813164.930456:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301718656 00000100:00100000:2.0:1788813164.930500:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301718784 00000100:00100000:2.0:1788813164.930503:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301718784 00000100:00100000:2.0:1788813164.930529:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 116 00000100:00100000:2.0:1788813164.930536:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301718656:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813164.930568:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301718656:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 33us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813164.930574:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 116 00000100:00100000:2.0:1788813164.930590:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 117 00000100:00100000:2.0:1788813164.930596:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301718784:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813164.930619:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301718784:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813164.930625:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 117 00000100:00080000:3.0:1788813164.933031:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813164.933044:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813165.315646:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813165.315684:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301719168 00000100:00100000:3.0:1788813165.315697:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301719168 00000100:00100000:3.0:1788813165.315773:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 152 00000100:00100000:3.0:1788813165.315787:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:12165:x1875706301719168:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813165.315817:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813165.316244:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff703413 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072989c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.316346:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70341a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.316360:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70341a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.316377:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70341a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318032:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703421 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318052:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703421 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318064:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703421 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318116:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70341a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318125:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70341a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318132:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70341a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318139:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813165.318144:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70341a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318171:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70341a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318186:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764bee00) 00010000:00010000:3.0:1788813165.318190:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813165.318195:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70341a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318203:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70341a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318220:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703421 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318227:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703421 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318234:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703421 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318240:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813165.318242:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703421 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318247:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703421 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318255:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff948a764be000) 00010000:00010000:3.0:1788813165.318258:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813165.318261:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703421 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318278:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703421 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318323:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff703413 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072989c expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318333:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764bee00) 00010000:00010000:3.0:1788813165.318336:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813165.318339:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff703413 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072989c expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.318351:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656600, rc 0) 00000100:00100000:3.0:1788813165.318439:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:12165:x1875706301719168:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 2654us (2802us total) trans 0 rc 301/301 00000100:00100000:3.0:1788813165.318449:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 152 00000100:00100000:2.0:1788813165.330727:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813165.332011:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301719424 00000100:00100000:0.0:1788813165.332035:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301719424 00000100:00100000:0.0:1788813165.332103:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 153 00000100:00100000:0.0:1788813165.332114:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+14:12165:x1875706301719424:12345-192.168.202.13@tcp:36:lfs.0 00010000:00010000:0.0:1788813165.332170:0:9156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813165.332196:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff702d75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296c7 expref: 14 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.332215:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764bee00) 00010000:00010000:0.0:1788813165.332225:0:9156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813165.332285:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703428 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.332299:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703428 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.332309:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703428 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.332320:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70342f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.332334:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70342f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.332341:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70342f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.332897:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703436 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.332908:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703436 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.332916:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703436 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813165.332971:0:9156:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e2c744c reply state 00000000341ace69 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703436 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.332985:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703436 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.332992:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:0.0:1788813165.332995:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788813165.332997:0:9156:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788813165.333002:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788813165.333009:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703428 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.333016:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703428 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.333024:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703428 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.333037:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813165.333041:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703428 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.333049:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703428 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.333059:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a74a15500) 00010000:00010000:0.0:1788813165.333062:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813165.333066:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703428 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.333073:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703428 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813165.333089:0:9156:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e2c744c reply state 00000000341ace69 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70342f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.333098:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70342f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.333104:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff948a74a15b00) 00010000:00010000:0.0:1788813165.333106:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788813165.333108:0:9156:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788813165.333202:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:12165:x1875706301719424:12345-192.168.202.13@tcp:36:lfs.0 Request processed in 1087us (2480us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788813165.333210:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 153 00000100:00100000:3.0:1788813165.456049:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813165.456091:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301719552 00000100:00100000:3.0:1788813165.456101:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301719552 00000100:00100000:3.0:1788813165.456156:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 154 00000100:00100000:3.0:1788813165.456167:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+15:12173:x1875706301719552:12345-192.168.202.13@tcp:101:lctl.0 00010000:00010000:3.0:1788813165.456199:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813165.456224:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70343d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07298a3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.456286:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703444 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.456316:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.456329:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813165.456376:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788813165.456379:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813165.457602:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.457638:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70343d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298a3 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.457657:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703444 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298a3 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.457666:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764be000) 00010000:00010000:3.0:1788813165.457669:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813165.457672:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657e00, rc 0) 00000100:00100000:3.0:1788813165.457731:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:12173:x1875706301719552:12345-192.168.202.13@tcp:101:lctl.0 Request processed in 1567us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813165.457739:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 154 00000100:00100000:1.0:1788813165.537911:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813165.538145:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301719680 00000100:00100000:3.0:1788813165.538156:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301719680 00000100:00100000:3.0:1788813165.538223:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 155 00000100:00100000:3.0:1788813165.538233:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+16:12179:x1875706301719680:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:3.0:1788813165.538254:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813165.538289:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70344b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07298aa expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538351:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703452 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538365:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538376:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538386:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff703459 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538393:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff703459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538596:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff703459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538674:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff703460 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538684:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff703460 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538691:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff703460 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813165.538725:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788813165.538729:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813165.538748:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff703460 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538766:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538772:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703452 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538779:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703452 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538784:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813165.538788:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703452 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538796:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703452 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538808:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764be000) 00010000:00010000:3.0:1788813165.538810:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813165.538815:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703452 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538821:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703452 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538833:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff703459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538839:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff703459 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.538844:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff703459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.539236:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813165.539243:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff703459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.539250:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff703459 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.539259:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff948a74a15b00) 00010000:00010000:3.0:1788813165.539261:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813165.539264:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff703459 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.539270:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff703459 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.539298:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff70344b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298aa expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.539313:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff703460 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298aa expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.539319:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:3.0:1788813165.539322:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788813165.539324:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657800, rc 0) 00000100:00100000:3.0:1788813165.539390:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+17:12179:x1875706301719680:12345-192.168.202.13@tcp:101:bash.0 Request processed in 1158us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813165.539405:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 155 00010000:00010000:0.0:1788813165.541980:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813165.546467:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813165.546734:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301719936 00000100:00100000:0.0:1788813165.546749:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301719936 00000100:00100000:0.0:1788813165.546845:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 156 00000100:00100000:0.0:1788813165.546857:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+17:12179:x1875706301719936:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813165.546895:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813165.546956:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703467 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07298b1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.547101:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70346e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.547121:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70346e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.547137:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70346e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.547290:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703475 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.547314:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703475 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.547327:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703475 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813165.547700:0:6496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788813165.547818:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70347c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.547827:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70347c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.547835:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70347c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.547880:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70346e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.547885:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70346e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.547890:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70346e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.547894:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813165.547897:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70346e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.547901:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70346e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.547910:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:0.0:1788813165.547912:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813165.547926:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70346e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.547969:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70346e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813165.547984:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bca64a2c reply state 00000000302799ef transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703475 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.548004:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703475 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.548010:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15900) 00010000:00010000:0.0:1788813165.548022:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788813165.548026:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788813165.548065:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703467 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b1 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.548079:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70347c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b1 expref: 19 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.548086:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:0.0:1788813165.548088:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813165.548090:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e5a00, rc 0) 00000100:00100000:0.0:1788813165.548167:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:12179:x1875706301719936:12345-192.168.202.13@tcp:101:bash.0 Request processed in 1312us (1725us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1788813165.548176:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 156 00000100:00100000:2.0:1788813165.552640:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813165.552732:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301720064 00000100:00100000:1.0:1788813165.552743:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301720064 00000100:00100000:1.0:1788813165.552804:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 55 00000100:00100000:1.0:1788813165.552814:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489434b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301720064:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:1.0:1788813165.552832:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813165.552851:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ce0163b/0xf32533d6ff70348a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07298b8 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813165.552876:0:8404:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813165.552898:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=318s v=(0 0) 00010000:00010000:1.0:1788813165.552902:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813165.552912:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ce0163b/0xf32533d6ff70348a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b8 expref: 6 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.552965:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ce0163b/0xf32533d6ff70348a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b8 expref: 6 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.552995:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac400, rc 0) 00000100:00100000:1.0:1788813165.553057:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489434b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2396:x1875706301720064:12345-192.168.202.13@tcp:101:bash.0 Request processed in 244us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.553063:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 55 00000100:00100000:3.0:1788813165.557177:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813165.557343:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301720192 00000100:00100000:2.0:1788813165.557356:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301720192 00000100:00100000:2.0:1788813165.557434:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 56 00000100:00100000:2.0:1788813165.557445:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:12179:x1875706301720192:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:2.0:1788813165.557464:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813165.557493:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07298bf expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.557546:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ce0163b/0xf32533d6ff70348a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b8 expref: 7 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.557556:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813165.557560:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813165.557564:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.557599:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ce0163b/0xf32533d6ff70348a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b8 expref: 7 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.557612:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ce0163b/0xf32533d6ff70348a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b8 expref: 7 pid: 8404 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813165.557627:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1875706313310848:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813165.557743:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ebfdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813165.561156:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1875706313310848:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813165.561199:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.561222:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08200, rc 0) 00000100:00100000:0.0:1788813165.561401:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813165.561518:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301720320 00000100:00100000:2.0:1788813165.561527:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301720320 00010000:00010000:2.0:1788813165.561564:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ce0163b/0xf32533d6ff70348a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b8 expref: 8 pid: 8404 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813165.561619:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 79 00000100:00100000:2.0:1788813165.561628:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2397:x1875706301720320:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813165.561645:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813165.561667:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ce0163b/0xf32533d6ff70348a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b8 expref: 8 pid: 8404 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.561679:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ce0163b/0xf32533d6ff70348a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b8 expref: 8 pid: 8404 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.561702:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ce0163b/0xf32533d6ff70348a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b8 expref: 8 pid: 8404 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.561717:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813165.561721:0:9502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813165.561728:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.561737:0:9502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.561768:0:9502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813165.561781:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9502:1875706313310976:192.168.202.13@tcp:105: 00000100:00100000:2.0:1788813165.561839:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ebfdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813165.562612:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:12179:x1875706301720192:12345-192.168.202.13@tcp:101:bash.0 Request processed in 3946us (4227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.562623:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 56 00000100:00100000:2.0:1788813165.568720:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9502:1875706313310976:192.168.202.13@tcp:105: 00010000:00010000:2.0:1788813165.568749:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813165.568817:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813165.568838:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2397:x1875706301720320:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 7207us (7447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813165.568851:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 79 00000100:00100000:3.0:1788813165.569480:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301720576 00000100:00100000:3.0:1788813165.569493:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301720576 00000100:00100000:3.0:1788813165.569567:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 36 00000100:00100000:3.0:1788813165.569579:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:12179:x1875706301720576:12345-192.168.202.13@tcp:35:bash.0 00000100:00100000:3.0:1788813165.570344:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12179:x1875706301720576:12345-192.168.202.13@tcp:35:bash.0 Request processed in 764us (1532us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788813165.570352:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 36 00000100:00100000:1.0:1788813165.711548:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813165.711858:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301720832 00000100:00100000:2.0:1788813165.711872:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301720832 00000100:00100000:2.0:1788813165.712008:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 157 00000100:00100000:2.0:1788813165.712022:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12189:x1875706301720832:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813165.712061:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813165.712090:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703498 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07298c6 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813165.712238:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788813165.712383:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703498 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298c6 expref: 23 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.712401:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764be000) 00010000:00010000:2.0:1788813165.712405:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813165.712411:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703498 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298c6 expref: 23 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.712429:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09200, rc 0) 00000100:00100000:2.0:1788813165.712820:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:12189:x1875706301720832:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 800us (1285us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1788813165.712829:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 157 00000100:00100000:2.0:1788813165.724059:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813165.724298:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301721088 00000100:00100000:3.0:1788813165.724312:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301721088 00000100:00100000:3.0:1788813165.724391:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 37 00000100:00100000:3.0:1788813165.724402:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:12189:x1875706301721088:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:3.0:1788813165.725006:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+23:12189:x1875706301721088:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 605us (961us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788813165.725031:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 37 00000100:00100000:0.0:1788813165.823244:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813165.823546:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301721216 00000100:00100000:3.0:1788813165.823559:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301721216 00000100:00100000:3.0:1788813165.823646:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 158 00000100:00100000:3.0:1788813165.823659:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+23:12195:x1875706301721216:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813165.823691:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813165.823718:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7034a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07298cd expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.823807:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7034ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.823825:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7034ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.823858:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7034ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813165.823925:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788813165.823929:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813165.824007:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7034ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.824040:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7034a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298cd expref: 25 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.824064:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7034ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298cd expref: 24 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.824074:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:3.0:1788813165.824078:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813165.824082:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657a00, rc 0) 00000100:00100000:2.0:1788813165.824394:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:12195:x1875706301721216:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 736us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813165.824402:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 158 00000100:00100000:1.0:1788813165.834766:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813165.841312:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301721472 00000100:00100000:0.0:1788813165.841333:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301721472 00000100:00100000:2.0:1788813165.841456:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 159 00000100:00100000:2.0:1788813165.841474:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:12195:x1875706301721472:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813165.841503:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813165.841532:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7034b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07298d4 expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.841690:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7034bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.841708:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7034bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.841724:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7034bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813165.841738:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788813165.841891:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7034b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298d4 expref: 27 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.841922:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7034bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298d4 expref: 26 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.841954:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:2.0:1788813165.841958:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813165.841963:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09000, rc 0) 00000100:00100000:2.0:1788813165.842076:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+26:12195:x1875706301721472:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 608us (7324us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1788813165.842085:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 159 00000100:00100000:3.0:1788813165.844767:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813165.844811:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301721600 00000100:00100000:2.0:1788813165.844823:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301721600 00000100:00100000:2.0:1788813165.844910:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12 00000100:00100000:2.0:1788813165.844954:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+26:2397:x1875706301721600:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813165.844976:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813165.845004:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7034bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298d4 expref: 26 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.845030:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:2.0:1788813165.845036:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813165.845101:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:2397:x1875706301721600:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 173us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813165.845110:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12 00000100:00100000:0.0:1788813165.861762:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813165.862697:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301721856 00000100:00100000:2.0:1788813165.862712:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301721856 00000100:00100000:2.0:1788813165.862841:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 160 00000100:00100000:2.0:1788813165.862854:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:12195:x1875706301721856:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813165.862897:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813165.862958:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7034c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07298db expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.863325:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7034d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.863365:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7034d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.863380:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7034d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813165.863397:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788813165.863596:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7034c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298db expref: 28 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.863684:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7034d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298db expref: 27 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.863694:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:2.0:1788813165.863698:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788813165.863702:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09200, rc 0) 00000100:00100000:2.0:1788813165.863788:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:12195:x1875706301721856:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 936us (2040us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1788813165.863796:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 160 00000100:00100000:3.0:1788813165.874610:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813165.874798:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301721984 00000100:00100000:0.0:1788813165.874812:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301721984 00000100:00100000:0.0:1788813165.874896:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 57 00000100:00100000:0.0:1788813165.874909:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2396:x1875706301721984:12345-192.168.202.13@tcp:1:lfs.0 00010000:00010000:0.0:1788813165.875013:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000107f7a94/0xf32533d6ff7034de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.875039:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 6 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.875072:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813165.875077:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813165.875082:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000107f7a94/0xf32533d6ff7034de lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.875125:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 6 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.875141:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 6 pid: 8405 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813165.875160:0:8403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8403:1875706313311104:192.168.202.13@tcp:104: 00000100:00100000:0.0:1788813165.875266:0:8403:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943613a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813165.878995:0:8403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8403:1875706313311104:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813165.879039:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000107f7a94/0xf32533d6ff7034de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813165.880741:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813165.880862:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301722112 00000100:00100000:2.0:1788813165.880873:0:8410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301722112 00002000:00100000:0.0:1788813165.890309:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff948944025f80 x1875706301722112/t0(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:736/0 lens 504/0 e 0 to 0 dl 1788813176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813165.890328:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948944025f80 with x1875706301722112 ext(0->12) 00010000:00010000:0.0:1788813165.890341:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 7 pid: 8405 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.890366:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 7 pid: 8405 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813165.890517:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff948944025f80 00000100:00100000:0.0:1788813165.890571:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2 00000100:00100000:0.0:1788813165.890604:0:8410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301722112:12345-192.168.202.13@tcp:4:lfs.0 00000100:00100000:0.0:1788813165.893856:0:8410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2396:x1875706301722112:12345-192.168.202.13@tcp:4:lfs.0 Request processed in 3240us (13111us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788813165.893963:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2 00002000:00100000:0.0:1788813165.893982:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff948944025f80 x1875706301722112/t4294967306(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:736/0 lens 504/448 e 0 to 0 dl 1788813176 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813165.893993:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948944025f80 with x1875706301722112 ext(0->12) 00010000:00010000:0.0:1788813165.894005:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 9 pid: 8405 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.894029:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 9 pid: 8405 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813165.894039:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff948944025f80 00000100:00100000:3.0:1788813165.897986:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813165.898104:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301722240 00000100:00100000:0.0:1788813165.898119:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301722240 00010000:00010000:0.0:1788813165.898171:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 9 pid: 8405 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813165.898222:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 80 00000100:00100000:0.0:1788813165.898234:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2397:x1875706301722240:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813165.898253:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788813165.898280:0:6478:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788813165.898284:0:6478:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788813166 00002000:00010000:0.0:1788813165.898286:0:6478:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788813166 00002000:00010000:0.0:1788813165.898308:0:6478:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788813166 00002000:00010000:0.0:1788813165.898310:0:6478:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788813165.898319:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 9 pid: 8405 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.898336:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 9 pid: 8405 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.898367:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f337975/0xf32533d6ff703491 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298bf expref: 9 pid: 8405 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.898402:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813165.898408:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813165.898414:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000107f7a94/0xf32533d6ff7034de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.898427:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000107f7a94/0xf32533d6ff7034de lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.898462:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813165.898768:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000107f7a94/0xf32533d6ff7034de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.898779:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000107f7a94/0xf32533d6ff7034de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.898804:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000107f7a94/0xf32533d6ff7034de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.898814:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000107f7a94/0xf32533d6ff7034de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.898833:0:8403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000107f7a94/0xf32533d6ff7034de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.898841:0:8403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813165.898847:0:8403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000107f7a94/0xf32533d6ff7034de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.898858:0:8403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000107f7a94/0xf32533d6ff7034de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.898872:0:8403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000107f7a94/0xf32533d6ff7034de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.898881:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000107f7a94/0xf32533d6ff7034de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813165.899412:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2397:x1875706301722240:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 1175us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813165.899422:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 80 00000100:00100000:1.0:1788813165.899553:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301721984:12345-192.168.202.13@tcp:1:lfs.0 Request processed in 24646us (24957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.899562:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 57 00000100:00100000:3.0:1788813165.902586:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813165.902743:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301722496 00000100:00100000:2.0:1788813165.902754:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301722496 00000100:00100000:2.0:1788813165.902852:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 38 00000100:00100000:2.0:1788813165.902864:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a612cec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:12195:x1875706301722496:12345-192.168.202.13@tcp:35:lfs.0 00000004:00010000:2.0:1788813165.903196:0:6498:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7034d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298db expref: 27 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813165.903774:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1788813165.903833:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788813165.904348:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1788813165.904723:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7034e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.904743:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70347c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b1 expref: 31 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.904753:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7034e5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.904798:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70347c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b1 expref: 31 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.904817:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70347c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b1 expref: 31 pid: 6496 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813165.904834:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1875706313311232:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813165.905197:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ebfd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813165.909326:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813165.909582:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301722624 00000100:00100000:0.0:1788813165.909596:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301722624 00010000:00010000:0.0:1788813165.909670:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70347c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b1 expref: 32 pid: 6496 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813165.909795:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 81 00000100:00100000:0.0:1788813165.909807:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:2396:x1875706301722624:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813165.909828:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813165.909836:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70347c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b1 expref: 32 pid: 6496 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.909852:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70347c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b1 expref: 32 pid: 6496 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.909892:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:0.0:1788813165.909898:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7034e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.909911:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7034e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.909929:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7034e5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.909975:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813165.910055:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:2396:x1875706301722624:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 250us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813165.910063:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 81 00010000:00010000:3.0:1788813165.910516:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff70347c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298b1 expref: 31 pid: 6496 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813165.910537:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1875706313311232:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813165.910566:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7034e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.910587:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7034e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.910594:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7034e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813165.910757:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1788813165.910896:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1788813165.911076:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944027b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313311360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788813165.911138:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813165.911171:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45b7a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813165.911198:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313311360 00000100:00100000:3.0:1788813165.911203:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313311360 00000100:00100000:3.0:1788813165.911253:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788813165.911261:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6498:x1875706313311360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788813165.911349:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6498:x1875706313311360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813165.911356:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1788813165.911378:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813165.911407:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944027b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313311360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788813165.911532:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1788813165.911574:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944027b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313311488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788813165.911600:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813165.911620:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45b7a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813165.913195:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313311488 00000100:00100000:1.0:1788813165.913208:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313311488 00000100:00100000:1.0:1788813165.913271:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788813165.913281:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6498:x1875706313311488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788813165.913579:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6498:x1875706313311488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 298us (1977us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788813165.913607:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788813165.913826:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944027b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313311488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788813165.914029:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1788813165.914084:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7034e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.914096:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7034e5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.914113:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7034e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.914120:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813165.914126:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7034e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.914135:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7034e5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.914154:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:2.0:1788813165.914158:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788813165.914163:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7034e5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.914171:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7034e5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788813165.914296:0:6498:0:(mdd_object.c:4199:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788813165.914375:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1788813165.914390:0:6498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 318933457489ns, next at 319933454995ns, rc = 0 00000001:00080000:2.0:1788813165.914396:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1788813165.914421:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:2.0:1788813165.914425:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788813165.914433:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7034d0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298db expref: 35 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813165.914603:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a612cec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+34:12195:x1875706301722496:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 11741us (12028us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1788813165.914632:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 38 00000020:00080000:2.0:1788813165.914638:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788813165.917595:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813165.917798:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301722752 00000100:00100000:0.0:1788813165.917810:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301722752 00000100:00100000:1.0:1788813165.918195:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 161 00000100:00100000:1.0:1788813165.918211:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6a8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+34:12195:x1875706301722752:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813165.918243:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813165.918273:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7034ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07298e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.918352:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7034ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298e2 expref: 35 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.918371:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7034ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298e2 expref: 35 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.918393:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:1.0:1788813165.918396:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813165.918401:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac600, rc 0) 00000100:00100000:1.0:1788813165.918481:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6a8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+35:12195:x1875706301722752:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 274us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.918488:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 161 00000100:00100000:3.0:1788813165.920820:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813165.921077:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301723008 00000100:00100000:0.0:1788813165.921089:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301723008 00000100:00100000:0.0:1788813165.921181:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 39 00000100:00100000:0.0:1788813165.921191:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+35:12195:x1875706301723008:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:0.0:1788813165.921478:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+36:12195:x1875706301723008:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 287us (668us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788813165.921487:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 39 00000100:00100000:2.0:1788813165.928143:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313311616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813165.928242:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813165.928312:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813165.928320:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313311744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813165.928347:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813165.928386:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313311616 00000100:00100000:2.0:1788813165.928395:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313311616 00000100:00100000:2.0:1788813165.928460:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313311744 00000100:00100000:2.0:1788813165.928463:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313311744 00000100:00100000:2.0:1788813165.928483:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788813165.928492:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313311616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813165.928532:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788813165.928582:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313311616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813165.928590:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788813165.928751:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788813165.928766:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313311744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813165.928779:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788813165.928817:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313311744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813165.928830:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1788813165.928861:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813165.930408:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313311872:0@lo:400:kworker.0 00000100:00100000:0.0:1788813165.930474:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813165.930516:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313312384:0@lo:400:kworker.0 00000100:00100000:0.0:1788813165.930545:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813165.930564:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313312896:0@lo:400:kworker.0 00000100:00100000:0.0:1788813165.930590:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813165.932257:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313312000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813165.932333:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813165.932397:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313312512:0@lo:400:kworker.0 00000100:00100000:2.0:1788813165.932424:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813165.932447:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313313024:0@lo:400:kworker.0 00000100:00100000:2.0:1788813165.932474:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813165.932573:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313311872 00000100:00100000:0.0:1788813165.932584:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313311872 00000100:00100000:0.0:1788813165.932657:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788813165.932668:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313311872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813165.932731:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313311872:12345-0@lo:400:kworker.0 Request processed in 65us (2257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813165.932738:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788813165.932780:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313312896 00000100:00100000:0.0:1788813165.932785:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313312896 00000100:00100000:0.0:1788813165.932830:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788813165.932838:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313312896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813165.932874:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313312896:12345-0@lo:400:kworker.0 Request processed in 38us (2283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813165.932893:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1788813165.932957:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813165.932997:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313311872:0@lo:400:kworker.0 00000100:00100000:0.0:1788813165.933015:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313312896:0@lo:400:kworker.0 00000100:00100000:0.0:1788813165.933266:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313312384 00000100:00100000:0.0:1788813165.933272:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313312384 00000100:00100000:0.0:1788813165.933306:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313313024 00000100:00100000:0.0:1788813165.933309:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313313024 00000100:00100000:0.0:1788813165.933337:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788813165.933343:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313312384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813165.933385:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313312384:12345-0@lo:400:kworker.0 Request processed in 42us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813165.933392:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788813165.933405:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788813165.933411:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313313024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813165.933545:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313312256:0@lo:400:kworker.0 00000100:00100000:3.0:1788813165.933591:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813165.933636:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313312768:0@lo:400:kworker.0 00000100:00100000:3.0:1788813165.933661:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813165.933681:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788813165.933688:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313312128:0@lo:400:kworker.0 00000100:00100000:3.0:1788813165.933711:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813165.933722:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313312640:0@lo:400:kworker.0 00000100:00100000:3.0:1788813165.933741:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813165.933751:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313313152:0@lo:400:kworker.0 00000100:00100000:3.0:1788813165.933770:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813165.933816:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313311744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813165.933835:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313311616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813165.934298:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313312000 00000100:00100000:1.0:1788813165.934306:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313312000 00000100:00100000:1.0:1788813165.934340:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313312512 00000100:00100000:1.0:1788813165.934344:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313312512 00000100:00100000:1.0:1788813165.934356:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313312256 00000100:00100000:1.0:1788813165.934359:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313312256 00000100:00100000:1.0:1788813165.934373:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788813165.934380:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3628:x1875706313312000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788813165.934430:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788813165.934490:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3628:x1875706313312000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (2157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.934497:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788813165.934515:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788813165.934521:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313312512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813165.934554:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313312512:12345-0@lo:400:kworker.0 Request processed in 34us (2129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.934560:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788813165.934571:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788813165.934577:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313312256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813165.934626:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313312256:12345-0@lo:400:kworker.0 Request processed in 49us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.934631:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788813165.934677:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313312256:0@lo:400:kworker.0 00000100:00100000:1.0:1788813165.934723:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313312768 00000100:00100000:1.0:1788813165.934728:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313312768 00000100:00100000:1.0:1788813165.934762:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313312128 00000100:00100000:1.0:1788813165.934765:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313312128 00000100:00100000:1.0:1788813165.934778:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313312640 00000100:00100000:1.0:1788813165.934782:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313312640 00000100:00100000:1.0:1788813165.934799:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313313152 00000100:00100000:1.0:1788813165.934803:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313313152 00000100:00100000:1.0:1788813165.934821:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788813165.934828:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313312768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813165.934870:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313312768:12345-0@lo:400:kworker.0 Request processed in 42us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.935653:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788813165.935680:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788813165.935690:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313312128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813165.935745:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313312128:12345-0@lo:400:kworker.0 Request processed in 59us (2033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.935751:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788813165.935763:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788813165.935769:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313312640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813165.935800:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313312640:12345-0@lo:400:kworker.0 Request processed in 32us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.935806:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788813165.935817:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788813165.935823:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313313152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813165.935849:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313313152:12345-0@lo:400:kworker.0 Request processed in 27us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.935855:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788813165.936138:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313312128:0@lo:400:kworker.0 00000100:00100000:1.0:1788813165.936155:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313312640:0@lo:400:kworker.0 00010000:00080000:1.0:1788813165.936170:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489441a5880 x1875706313313152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813165.936181:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313313152:0@lo:400:kworker.0 00010000:00080000:1.0:1788813165.936195:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489436e5f80 x1875706313312768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813165.936222:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313312768:0@lo:400:kworker.0 00000100:00100000:2.0:1788813165.938559:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313312000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813165.938581:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313312512:0@lo:400:kworker.0 00000100:00080000:1.0:1788813165.938665:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788813165.938673:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813165.938802:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313313024:12345-0@lo:400:kworker.0 Request processed in 5387us (6322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813165.938816:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788813165.938889:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313312384:0@lo:400:kworker.0 00000100:00100000:2.0:1788813165.940484:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313313024:0@lo:400:kworker.0 00000100:00100000:3.0:1788813166.021906:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813166.022112:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301723264 00000100:00100000:1.0:1788813166.022126:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301723264 00000100:00080000:0.0:1788813166.022192:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813166.022246:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 162 00000100:00100000:1.0:1788813166.022261:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+36:12206:x1875706301723264:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813166.022296:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813166.022324:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7034f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07298e9 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813166.022469:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788813166.022603:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7034f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298e9 expref: 38 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.022617:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764be000) 00010000:00010000:1.0:1788813166.022619:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813166.022623:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7034f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298e9 expref: 38 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.022636:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dace00, rc 0) 00000100:00100000:1.0:1788813166.022703:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+37:12206:x1875706301723264:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 447us (812us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1788813166.022710:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 162 00000100:00100000:3.0:1788813166.028313:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813166.028445:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301723392 00000100:00100000:2.0:1788813166.028459:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301723392 00000100:00100000:2.0:1788813166.028552:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 163 00000100:00100000:2.0:1788813166.028566:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+37:12206:x1875706301723392:12345-192.168.202.13@tcp:34:lfs.0 00010000:00010000:2.0:1788813166.028699:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703501 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.028727:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703501 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.028745:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703501 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.028759:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703508 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.028767:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.028773:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.028975:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70350f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.028985:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70350f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.028993:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70350f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813166.029064:0:12571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70350f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029081:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703501 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029088:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703501 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029095:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703501 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029101:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813166.029106:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703501 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029114:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703501 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029127:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:2.0:1788813166.029130:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813166.029135:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703501 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029149:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703501 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029164:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029170:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703508 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029176:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703508 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029182:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813166.029185:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703508 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029192:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703508 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029200:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15900) 00010000:00010000:2.0:1788813166.029202:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813166.029205:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703508 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029211:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703508 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029223:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70350f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029228:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70350f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029241:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70350f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029246:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813166.029249:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70350f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029255:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70350f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029262:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:2.0:1788813166.029265:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813166.029268:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70350f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.029274:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70350f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813166.029368:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+37:12206:x1875706301723392:12345-192.168.202.13@tcp:34:lfs.0 Request processed in 804us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813166.029377:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 163 00000100:00100000:1.0:1788813166.034584:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813166.034797:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301723648 00000100:00100000:0.0:1788813166.034811:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301723648 00000100:00100000:0.0:1788813166.034893:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 40 00000100:00100000:0.0:1788813166.034906:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+37:12206:x1875706301723648:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:0.0:1788813166.035924:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:12206:x1875706301723648:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 1009us (1341us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788813166.035954:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 40 00000100:00100000:3.0:1788813166.081856:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813166.083787:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301723904 00000100:00100000:0.0:1788813166.083804:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301723904 00000100:00100000:0.0:1788813166.084065:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 164 00000100:00100000:0.0:1788813166.084078:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:12209:x1875706301723904:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813166.084111:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813166.084141:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703516 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07298f0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.084242:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70351d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.084260:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70351d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.084274:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70351d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.084286:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703524 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.084292:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.084298:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.084787:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70352b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.084798:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70352b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.084828:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70352b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813166.084839:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788813166.085234:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70351d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085244:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70351d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085252:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70351d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085259:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813166.085264:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70351d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085273:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70351d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085288:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:0.0:1788813166.085291:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813166.085297:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70351d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085304:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff70351d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085322:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085328:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703524 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085341:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703524 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085347:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdaa00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813166.085350:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703524 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085469:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703524 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085482:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15900) 00010000:00010000:0.0:1788813166.085485:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813166.085489:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703524 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085494:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703524 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085549:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703516 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298f0 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085564:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70352b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298f0 expref: 40 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.085572:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:0.0:1788813166.085574:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813166.085577:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdbc00, rc 0) 00000100:00100000:0.0:1788813166.085798:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+40:12209:x1875706301723904:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 1720us (3953us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788813166.085816:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 164 00000100:00100000:1.0:1788813166.089481:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813166.090548:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301724032 00000100:00100000:2.0:1788813166.090565:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301724032 00000100:00100000:2.0:1788813166.090651:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 165 00000100:00100000:2.0:1788813166.090664:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+40:12209:x1875706301724032:12345-192.168.202.13@tcp:54:lfs.0 00010000:00010000:2.0:1788813166.090768:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703539 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.090790:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.090819:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.090867:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.090886:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703539 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.090895:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703539 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.090901:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813166.090907:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703539 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.090925:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703539 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.090963:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:2.0:1788813166.090967:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813166.090974:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703539 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.090981:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703539 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813166.091088:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+40:12209:x1875706301724032:12345-192.168.202.13@tcp:54:lfs.0 Request processed in 425us (1620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813166.091097:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 165 00000100:00100000:2.0:1788813166.097663:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813166.103521:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301724288 00000100:00100000:3.0:1788813166.103545:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301724288 00000100:00100000:3.0:1788813166.103656:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 41 00000100:00100000:3.0:1788813166.103671:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+40:12209:x1875706301724288:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:3.0:1788813166.104592:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+41:12209:x1875706301724288:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 922us (6941us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788813166.104601:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 41 00000100:00100000:3.0:1788813166.509257:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813166.509557:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301724544 00000100:00100000:0.0:1788813166.509570:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301724544 00000100:00100000:0.0:1788813166.509661:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 166 00000100:00100000:0.0:1788813166.509674:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+41:12240:x1875706301724544:12345-192.168.202.13@tcp:101:cat.0 00010000:00010000:0.0:1788813166.509705:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813166.509734:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703540 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07298f7 expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.509880:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703547 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.509899:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703547 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.509926:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703547 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813166.509971:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788813166.510123:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703540 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298f7 expref: 44 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.510146:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703547 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298f7 expref: 43 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.510156:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:0.0:1788813166.510159:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813166.510163:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdb400, rc 0) 00000100:00100000:0.0:1788813166.511093:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+43:12240:x1875706301724544:12345-192.168.202.13@tcp:101:cat.0 Request processed in 1417us (1856us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788813166.511111:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 166 00000100:00100000:1.0:1788813166.528181:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813166.528239:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813166.528339:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301724928 00000100:00100000:0.0:1788813166.528352:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301724928 00000100:00100000:0.0:1788813166.528432:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 42 00000100:00100000:0.0:1788813166.528444:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+43:12240:x1875706301724928:12345-192.168.202.13@tcp:35:cat.0 00000100:00100000:0.0:1788813166.528797:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+44:12240:x1875706301724928:12345-192.168.202.13@tcp:35:cat.0 Request processed in 354us (555us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1788813166.528805:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 42 00000100:00100000:2.0:1788813166.530065:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301724672 00000100:00100000:2.0:1788813166.530086:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301724672 00000100:00100000:2.0:1788813166.530160:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:2.0:1788813166.530169:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944052d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+44:2397:x1875706301724672:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813166.530186:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813166.530226:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703547 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298f7 expref: 44 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.530253:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:2.0:1788813166.530259:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813166.530319:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944052d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+43:2397:x1875706301724672:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 151us (2155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813166.530326:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13 00010000:00010000:1.0:1788813166.565399:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813166.602110:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813166.602412:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301725184 00000100:00100000:3.0:1788813166.602444:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301725184 00000100:00100000:3.0:1788813166.602586:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 167 00000100:00100000:3.0:1788813166.602599:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+43:12246:x1875706301725184:12345-192.168.202.13@tcp:101:dd.0 00010000:00010000:3.0:1788813166.602642:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813166.602646:0:12571:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788813166.602684:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7034ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298cd expref: 43 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.602708:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:3.0:1788813166.602713:0:12571:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813166.602729:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff703555 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07298fe expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.602863:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.602893:0:12571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70352b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298f0 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.602902:0:12571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.603023:0:12571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70352b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298f0 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.603055:0:12571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70352b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298f0 expref: 43 pid: 6496 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813166.603071:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313313280:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813166.603203:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45b7a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813166.608078:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813166.608288:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313313280:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813166.608343:0:12571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813166.608529:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301725312 00000100:00100000:1.0:1788813166.608538:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301725312 00010000:00010000:1.0:1788813166.608590:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70352b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298f0 expref: 44 pid: 6496 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813166.608645:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 82 00000100:00100000:1.0:1788813166.608655:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+44:2396:x1875706301725312:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813166.608674:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813166.608682:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70352b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298f0 expref: 44 pid: 6496 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.608695:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70352b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298f0 expref: 44 pid: 6496 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.608721:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70352b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298f0 expref: 44 pid: 6496 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.608739:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:1.0:1788813166.608744:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.608754:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.608763:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.608821:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813166.608902:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+43:2396:x1875706301725312:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 247us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813166.608925:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 82 00010000:00010000:2.0:1788813166.609782:0:12571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.609795:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813166.609820:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788813166.610118:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff703555 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298fe expref: 44 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.610141:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298fe expref: 43 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.610150:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:2.0:1788813166.610153:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788813166.610172:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656e00, rc 0) 00000100:00100000:2.0:1788813166.610227:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+43:12246:x1875706301725184:12345-192.168.202.13@tcp:101:dd.0 Request processed in 7630us (8132us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788813166.610236:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 167 00000100:00100000:0.0:1788813166.614253:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813166.614346:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301725440 00000100:00100000:1.0:1788813166.614359:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301725440 00000100:00100000:1.0:1788813166.614433:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 168 00000100:00100000:1.0:1788813166.614446:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+43:12246:x1875706301725440:12345-192.168.202.13@tcp:101:dd.0 00010000:00010000:1.0:1788813166.614479:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813166.614506:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff70356a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729905 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.614552:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703571 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.614570:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.614585:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.614753:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff70356a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729905 expref: 45 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.614779:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703571 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729905 expref: 44 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.614788:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:1.0:1788813166.614799:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788813166.614803:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dada00, rc 0) 00000100:00100000:1.0:1788813166.614885:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+44:12246:x1875706301725440:12345-192.168.202.13@tcp:101:dd.0 Request processed in 440us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813166.614892:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 168 00000100:00100000:1.0:1788813166.621782:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813166.622180:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301725696 00000100:00100000:0.0:1788813166.622194:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301725696 00000100:00100000:0.0:1788813166.622278:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 169 00000100:00100000:0.0:1788813166.622290:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+44:12246:x1875706301725696:12345-192.168.202.13@tcp:36:dd.0 00010000:00010000:0.0:1788813166.622738:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff703578 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.622764:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff703578 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.622780:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff703578 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813166.622835:0:9156:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1788813166.622862:0:9156:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003363390 reply state 00000000b7d82ec8 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff703578 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.622919:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff703578 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.622928:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:0.0:1788813166.623055:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788813166.623061:0:9156:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813166.623227:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+47:12246:x1875706301725696:12345-192.168.202.13@tcp:36:dd.0 Request processed in 937us (1456us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1788813166.623236:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 169 00000020:00080000:0.0:1788813166.623243:0:9156:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788813166.861739:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813166.861897:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301725824 00000100:00100000:2.0:1788813166.861920:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301725824 00000100:00100000:2.0:1788813166.862041:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 170 00000100:00100000:2.0:1788813166.862053:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+47:12260:x1875706301725824:12345-192.168.202.13@tcp:101:stat.0 00010000:00010000:2.0:1788813166.862085:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813166.862115:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70357f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072990c expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.862295:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703586 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.862314:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703586 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.862328:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703586 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.862354:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff70358d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.862362:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff70358d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.862369:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff70358d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.862465:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703594 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.862496:0:12571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298fe expref: 48 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.862506:0:12571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703594 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.862550:0:12571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298fe expref: 48 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.862567:0:12571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298fe expref: 48 pid: 12571 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813166.862584:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76417b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313313408:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813166.863016:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ebfd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813166.869859:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813166.870017:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76417b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313313408:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813166.870242:0:12571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703594 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813166.870300:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301726080 00000100:00100000:0.0:1788813166.870434:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301726080 00000100:00100000:0.0:1788813166.870550:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 43 00000100:00100000:0.0:1788813166.870561:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+49:6156:x1875706301726080:12345-192.168.202.13@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788813166.871397:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+50:6156:x1875706301726080:12345-192.168.202.13@tcp:35:ldlm_bl.0 Request processed in 834us (1550us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788813166.871407:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 43 00000100:00100000:1.0:1788813166.874813:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813166.874966:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301726208 00000100:00100000:0.0:1788813166.874980:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301726208 00010000:00010000:0.0:1788813166.875095:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298fe expref: 50 pid: 12571 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813166.875198:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 83 00000100:00100000:0.0:1788813166.875210:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50683c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+50:2397:x1875706301726208:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813166.875229:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813166.875258:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298fe expref: 50 pid: 12571 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.875274:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298fe expref: 50 pid: 12571 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.875303:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff70355c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07298fe expref: 50 pid: 12571 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.875435:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:0.0:1788813166.875441:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703594 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.875453:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.875463:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703594 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.875502:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813166.875590:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50683c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+49:2397:x1875706301726208:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 381us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813166.875597:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 83 00010000:00010000:3.0:1788813166.876578:0:12571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876592:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813166.876680:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788813166.876686:0:12571:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813166.876714:0:12571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876730:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876741:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703586 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876748:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703586 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876756:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703586 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876780:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813166.876786:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703586 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876795:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703586 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876810:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:3.0:1788813166.876813:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813166.876818:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703586 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876825:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703586 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876841:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff70358d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876847:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff70358d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876854:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff70358d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876859:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813166.876862:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff70358d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876878:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff70358d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876900:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15900) 00010000:00010000:3.0:1788813166.876912:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813166.876916:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff70358d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.876922:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff70358d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.877020:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70357f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072990c expref: 49 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.877049:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703594 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072990c expref: 48 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.877058:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:3.0:1788813166.877061:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813166.877064:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08800, rc 0) 00000100:00100000:3.0:1788813166.877118:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+48:12260:x1875706301725824:12345-192.168.202.13@tcp:101:stat.0 Request processed in 15067us (15395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813166.877128:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 170 00000100:00100000:1.0:1788813166.982768:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813166.983332:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301726464 00000100:00100000:2.0:1788813166.983346:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301726464 00000100:00100000:2.0:1788813166.983434:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 171 00000100:00100000:2.0:1788813166.983447:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+48:12266:x1875706301726464:12345-192.168.202.13@tcp:36:truncate.0 00010000:00010000:2.0:1788813166.983526:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813166.983567:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703594 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072990c expref: 48 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.983593:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:2.0:1788813166.983774:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813166.984996:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70359b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.985049:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70359b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.985063:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70359b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813166.985121:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1788813166.985151:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d051af8f reply state 0000000067f81b4c transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70359b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.985165:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70359b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.985173:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:2.0:1788813166.985176:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788813166.985180:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813166.985450:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+50:12266:x1875706301726464:12345-192.168.202.13@tcp:36:truncate.0 Request processed in 2001us (2693us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788813166.985462:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 171 00000020:00080000:2.0:1788813166.985469:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788813167.265475:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813167.265613:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301726592 00000100:00100000:0.0:1788813167.265627:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301726592 00000100:00100000:0.0:1788813167.265710:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 172 00000100:00100000:0.0:1788813167.265722:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+50:12280:x1875706301726592:12345-192.168.202.13@tcp:101:stat.0 00010000:00010000:0.0:1788813167.265756:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813167.265798:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff7035a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729913 expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266177:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7035a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266196:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7035a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266210:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7035a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266349:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff7035b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266358:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff7035b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266365:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff7035b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266467:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266478:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266486:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813167.266541:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788813167.266546:0:9156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813167.266575:0:9156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266602:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266611:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7035a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266617:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7035a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266624:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7035a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266629:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdaa00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813167.266634:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7035a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266642:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7035a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266656:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:0.0:1788813167.266659:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813167.266665:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7035a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266672:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7035a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266688:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff7035b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266695:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff7035b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266708:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff7035b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266713:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdbc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813167.266716:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff7035b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266722:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff7035b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266730:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15900) 00010000:00010000:0.0:1788813167.266733:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813167.266736:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff7035b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266741:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff7035b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.266774:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff7035a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729913 expref: 52 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.267540:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729913 expref: 51 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.267549:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:0.0:1788813167.267552:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813167.267555:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f200, rc 0) 00000100:00100000:0.0:1788813167.267870:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+51:12280:x1875706301726592:12345-192.168.202.13@tcp:101:stat.0 Request processed in 2138us (2399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813167.267893:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 172 00000100:00100000:3.0:1788813167.403649:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813167.404128:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301726848 00000100:00100000:0.0:1788813167.404143:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301726848 00000100:00100000:2.0:1788813167.404377:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 173 00000100:00100000:2.0:1788813167.404392:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+51:12290:x1875706301726848:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813167.404428:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813167.404456:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7035be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072991a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813167.404588:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788813167.404716:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7035be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072991a expref: 53 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.404755:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764be000) 00010000:00010000:2.0:1788813167.404759:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813167.404766:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7035be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072991a expref: 53 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.404782:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08800, rc 0) 00000100:00100000:2.0:1788813167.404872:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+52:12290:x1875706301726848:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 484us (1240us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1788813167.404879:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 173 00000100:00100000:3.0:1788813167.409355:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813167.411732:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301727104 00000100:00100000:2.0:1788813167.411748:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301727104 00000100:00100000:2.0:1788813167.411915:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 44 00000100:00100000:2.0:1788813167.411928:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a612cf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+52:12290:x1875706301727104:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813167.412253:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a612cf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+53:12290:x1875706301727104:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 329us (2910us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1788813167.412260:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 44 00000100:00100000:1.0:1788813167.500591:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813167.500734:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301727360 00000100:00100000:2.0:1788813167.500750:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301727360 00000100:00100000:2.0:1788813167.500826:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 174 00000100:00100000:2.0:1788813167.500838:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+53:12296:x1875706301727360:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:2.0:1788813167.500865:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813167.500887:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7035cc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729921 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.501049:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.501078:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729913 expref: 54 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.501088:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.501134:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729913 expref: 54 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.501148:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729913 expref: 54 pid: 9156 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813167.501162:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943658380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313313536:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813167.501261:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ebfdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813167.503254:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943658380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313313536:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813167.503282:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813167.511060:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813167.512214:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301727488 00000100:00100000:2.0:1788813167.512230:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301727488 00010000:00010000:2.0:1788813167.512288:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729913 expref: 55 pid: 9156 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813167.512341:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 84 00000100:00100000:2.0:1788813167.512350:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944050700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+55:2397:x1875706301727488:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813167.512366:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813167.512386:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729913 expref: 55 pid: 9156 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.512408:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729913 expref: 55 pid: 9156 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.512430:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729913 expref: 55 pid: 9156 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.512449:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:2.0:1788813167.512455:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.512465:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.512473:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.512507:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813167.512570:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813167.512571:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944050700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+54:2397:x1875706301727488:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 221us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813167.512609:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 84 00010000:00010000:3.0:1788813167.512671:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813167.512724:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788813167.514257:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7035cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729921 expref: 55 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.514292:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729921 expref: 54 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.514302:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:3.0:1788813167.514306:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788813167.514310:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08200, rc 0) 00000100:00100000:3.0:1788813167.514402:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+54:12296:x1875706301727360:12345-192.168.202.13@tcp:101:bash.0 Request processed in 13564us (13823us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788813167.514412:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 174 00000100:00100000:3.0:1788813167.518894:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813167.521428:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301727744 00000100:00100000:2.0:1788813167.521444:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301727744 00000100:00100000:2.0:1788813167.521520:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 175 00000100:00100000:2.0:1788813167.521533:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+54:12296:x1875706301727744:12345-192.168.202.13@tcp:36:bash.0 00010000:00010000:2.0:1788813167.521773:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7035e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.521801:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7035e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.521811:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7035e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813167.521848:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1788813167.521866:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2a935bf reply state 0000000014db05f7 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7035e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.521879:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7035e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.521886:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:2.0:1788813167.521889:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788813167.521893:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813167.522034:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+57:12296:x1875706301727744:12345-192.168.202.13@tcp:36:bash.0 Request processed in 503us (3155us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1788813167.522041:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 175 00000020:00080000:2.0:1788813167.522046:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788813167.527583:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813167.527853:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301727872 00000100:00100000:0.0:1788813167.527876:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301727872 00000100:00100000:0.0:1788813167.528002:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 176 00000100:00100000:0.0:1788813167.528016:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+57:12296:x1875706301727872:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813167.528071:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813167.528319:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff7035e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729928 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.528440:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.528458:0:12571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729921 expref: 58 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.528469:0:12571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035ef lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.528513:0:12571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729921 expref: 58 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.528528:0:12571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729921 expref: 58 pid: 6495 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813167.528545:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313313664:192.168.202.13@tcp:104: 00000100:00100000:0.0:1788813167.528666:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943613b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813167.530768:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313313664:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813167.530807:0:12571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813167.533502:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813167.534075:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301728000 00000100:00100000:3.0:1788813167.534094:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301728000 00010000:00010000:3.0:1788813167.534148:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729921 expref: 59 pid: 6495 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813167.534197:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 85 00000100:00100000:3.0:1788813167.534208:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944239880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+59:2396:x1875706301728000:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813167.534227:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813167.534247:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729921 expref: 59 pid: 6495 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.534264:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729921 expref: 59 pid: 6495 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.534293:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff7035d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729921 expref: 59 pid: 6495 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.534313:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:3.0:1788813167.534319:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.534330:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.534339:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035ef lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.534387:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813167.534461:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944239880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+58:2396:x1875706301728000:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 254us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813167.534469:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 85 00010000:00010000:0.0:1788813167.535309:0:12571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.535321:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813167.535394:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788813167.535400:0:12571:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813167.535427:0:12571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.535474:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff7035e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729928 expref: 58 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.535496:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729928 expref: 57 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.535505:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:0.0:1788813167.535507:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813167.535510:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f200, rc 0) 00000100:00100000:0.0:1788813167.535567:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+57:12296:x1875706301727872:12345-192.168.202.13@tcp:101:bash.0 Request processed in 7554us (7999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813167.535575:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 176 00000100:00100000:1.0:1788813167.539494:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813167.539647:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301728256 00000100:00100000:0.0:1788813167.539661:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301728256 00000100:00100000:0.0:1788813167.539738:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 45 00000100:00100000:0.0:1788813167.539752:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+57:12296:x1875706301728256:12345-192.168.202.13@tcp:35:bash.0 00000100:00100000:0.0:1788813167.540354:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+58:12296:x1875706301728256:12345-192.168.202.13@tcp:35:bash.0 Request processed in 603us (873us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788813167.540388:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 45 00010000:00010000:0.0:1788813167.588796:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813167.643276:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813167.643537:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301728512 00000100:00100000:2.0:1788813167.643553:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301728512 00000100:00100000:2.0:1788813167.643636:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 177 00000100:00100000:2.0:1788813167.643649:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+58:12306:x1875706301728512:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813167.643682:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813167.643710:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7035f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072992f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813167.643841:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788813167.644076:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7035f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072992f expref: 60 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.644198:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764be000) 00010000:00010000:2.0:1788813167.644203:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813167.644210:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff7035f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072992f expref: 60 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.644227:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09200, rc 0) 00000100:00100000:2.0:1788813167.644438:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+59:12306:x1875706301728512:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 790us (1177us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1788813167.644446:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 177 00000100:00100000:1.0:1788813167.648571:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813167.648664:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301728640 00000100:00100000:2.0:1788813167.648677:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301728640 00000100:00100000:2.0:1788813167.648750:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 178 00000100:00100000:2.0:1788813167.648761:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+59:12306:x1875706301728640:12345-192.168.202.13@tcp:34:lfs.0 00010000:00010000:2.0:1788813167.648870:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703604 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.648891:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703604 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.648912:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703604 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.648925:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70360b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.648974:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70360b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649001:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70360b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649330:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703612 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649342:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703612 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649350:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703612 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813167.649412:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703612 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649429:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703604 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649437:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703604 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649444:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703604 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649451:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813167.649456:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703604 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649465:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703604 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649478:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:2.0:1788813167.649489:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813167.649495:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703604 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649501:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703604 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649517:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70360b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649524:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70360b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649531:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70360b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649536:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813167.649539:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70360b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649545:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70360b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649552:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15900) 00010000:00010000:2.0:1788813167.649555:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813167.649558:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70360b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649564:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70360b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649618:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703612 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649650:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703612 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649657:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703612 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649663:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813167.649666:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703612 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649673:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703612 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649681:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:2.0:1788813167.649683:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813167.649686:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703612 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.649692:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff703612 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813167.649838:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+59:12306:x1875706301728640:12345-192.168.202.13@tcp:34:lfs.0 Request processed in 1075us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813167.649847:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 178 00000100:00100000:1.0:1788813167.653199:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813167.653337:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301728896 00000100:00100000:2.0:1788813167.653350:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301728896 00000100:00100000:2.0:1788813167.653423:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00100000:2.0:1788813167.653435:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+59:12306:x1875706301728896:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813167.653736:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+60:12306:x1875706301728896:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 302us (550us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788813167.653763:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00100000:3.0:1788813167.696764:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813167.697004:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301729152 00000100:00100000:0.0:1788813167.697019:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301729152 00000100:00100000:0.0:1788813167.697127:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 179 00000100:00100000:0.0:1788813167.697142:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+60:12309:x1875706301729152:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813167.697176:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813167.697203:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703619 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729936 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697307:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703620 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697326:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703620 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697340:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703620 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697353:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703627 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697360:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703627 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697367:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703627 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697512:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff70362e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697547:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff70362e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697555:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff70362e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813167.697568:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788813167.697694:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703620 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697702:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703620 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697710:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703620 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697716:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813167.697721:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703620 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697729:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703620 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697742:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:0.0:1788813167.697745:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813167.697751:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703620 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697757:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703620 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697775:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703627 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697788:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703627 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697793:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703627 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697810:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdbc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813167.697813:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703627 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697819:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703627 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697827:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15900) 00010000:00010000:0.0:1788813167.697830:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813167.697833:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703627 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.697838:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703627 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.699149:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703619 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729936 expref: 63 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.699180:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff70362e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729936 expref: 62 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.699189:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:0.0:1788813167.699191:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813167.699205:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdaa00, rc 0) 00000100:00100000:0.0:1788813167.699305:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+62:12309:x1875706301729152:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 2166us (2556us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788813167.699315:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 179 00000100:00100000:1.0:1788813167.703877:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813167.704259:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301729280 00000100:00100000:3.0:1788813167.704274:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301729280 00000100:00100000:3.0:1788813167.704352:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 180 00000100:00100000:3.0:1788813167.704364:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+62:12309:x1875706301729280:12345-192.168.202.13@tcp:54:lfs.0 00010000:00010000:3.0:1788813167.704485:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70363c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.704509:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70363c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.704524:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70363c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.704567:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70363c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.704574:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70363c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.704581:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70363c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.704586:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813167.704591:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70363c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.704599:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70363c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.704612:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:3.0:1788813167.704616:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813167.704620:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70363c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.704627:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff70363c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813167.704734:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+62:12309:x1875706301729280:12345-192.168.202.13@tcp:54:lfs.0 Request processed in 372us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813167.704742:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 180 00000001:00080000:2.0:1788813167.705164:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000004:00080000:2.0:1788813167.705303:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788813167.705326:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff948a488bf240 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788813167.705331:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948a6ed19200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff948a488bf000 00000020:00080000:2.0:1788813167.705334:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948a6ed19300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff948943700400 00000020:00080000:0.0:1788813167.705393:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788813167.705455:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788813167.705742:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313313792:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788813167.705893:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70342f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.705962:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70342f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.705970:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70342f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.705977:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166fc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813167.705981:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70342f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.705989:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70342f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706005:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff948a74a15b00) 00010000:00010000:3.0:1788813167.706009:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813167.706014:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70342f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706021:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70342f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706056:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703436 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706078:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703436 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706084:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703436 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706371:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813167.706376:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703436 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706384:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703436 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706394:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:3.0:1788813167.706396:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813167.706400:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703436 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706406:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703436 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706427:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703475 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706433:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703475 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706438:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703475 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706443:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813167.706453:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703475 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706460:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703475 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706469:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15900) 00010000:00010000:3.0:1788813167.706472:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813167.706475:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703475 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706480:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff703475 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706500:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff703578 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706506:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff703578 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706512:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff703578 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706517:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813167.706520:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff703578 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706525:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff703578 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706532:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:3.0:1788813167.706535:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813167.706544:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff703578 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706550:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff703578 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706561:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70359b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706567:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70359b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706573:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70359b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706579:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813167.706582:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70359b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706589:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70359b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706597:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:3.0:1788813167.706599:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813167.706602:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70359b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706607:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff70359b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706618:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7035e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706624:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7035e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706641:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7035e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706648:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813167.706652:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7035e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706659:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7035e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706667:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:3.0:1788813167.706670:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813167.706673:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7035e1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.706680:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7035e1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813167.709568:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813167.709597:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813167.709650:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313313792 00000100:00100000:1.0:1788813167.709665:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313313792 00000100:00080000:2.0:1788813167.709705:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813167.709767:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788813167.709784:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3626:x1875706313313792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788813167.709827:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:1.0:1788813167.709883:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f1f6e, atime: 0x6a9f1f6e, ctime: 0x6a9f1f6e, blocks: 0x8 00010000:00010000:1.0:1788813167.709892:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703643 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.709922:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=320s v=(0 0) 00010000:00010000:1.0:1788813167.709976:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813167.709986:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703643 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.710008:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703643 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.710021:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703643 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.710030:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703643 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.710048:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788813167.710382:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3626:x1875706313313792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 602us (792us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788813167.710389:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:1.0:1788813167.710458:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948944239f80/2, rc 0, transno 4294967308 00000100:00100000:1.0:1788813167.710466:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313313792:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788813167.710911:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301729408 00000100:00100000:0.0:1788813167.710923:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301729408 00000100:00100000:0.0:1788813167.711001:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00100000:0.0:1788813167.711011:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:2399:x1875706301729408:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813167.711027:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813167.711052:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff70362e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729936 expref: 18 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.711073:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:0.0:1788813167.711078:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813167.711132:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+17:2399:x1875706301729408:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 123us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813167.711139:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 14 00010000:00010000:2.0:1788813167.711344:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813167.711352:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703643 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.711372:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813167.711376:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703643 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.711387:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703643 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.711401:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703643 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.711408:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703643 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.711448:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813167.711450:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813167.711452:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813167.714435:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813167.714543:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301729664 00000100:00100000:2.0:1788813167.714556:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301729664 00000100:00100000:2.0:1788813167.714642:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 47 00000100:00100000:2.0:1788813167.714653:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+17:12309:x1875706301729664:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813167.715393:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:12309:x1875706301729664:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 738us (969us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788813167.715403:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 47 00000100:00100000:1.0:1788813167.908761:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813167.908853:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301729920 00000100:00100000:2.0:1788813167.908867:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301729920 00000100:00100000:2.0:1788813167.908997:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 181 00000100:00100000:2.0:1788813167.909011:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:12327:x1875706301729920:12345-192.168.202.13@tcp:101:cat.0 00010000:00010000:2.0:1788813167.909054:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813167.909084:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70364a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072993d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.909431:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703651 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.909451:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703651 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.909466:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703651 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813167.909504:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788813167.909647:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70364a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072993d expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.909671:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703651 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072993d expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.909682:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:2.0:1788813167.909686:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788813167.909690:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09c00, rc 0) 00000100:00100000:2.0:1788813167.909773:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:12327:x1875706301729920:12345-192.168.202.13@tcp:101:cat.0 Request processed in 765us (1028us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788813167.909782:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 181 00000100:00100000:1.0:1788813167.963479:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813167.963686:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301730048 00000100:00100000:0.0:1788813167.963700:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301730048 00000100:00100000:0.0:1788813167.963870:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 182 00000100:00100000:0.0:1788813167.963884:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:12328:x1875706301730048:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813167.963928:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813167.964007:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff70365f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729944 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.964543:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703666 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.964562:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703666 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.964577:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703666 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813167.964634:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788813167.964639:0:12571:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813167.964664:0:12571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703666 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.964699:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff70365f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729944 expref: 22 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.964725:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703666 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729944 expref: 21 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.964735:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:0.0:1788813167.964738:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813167.964742:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdbc00, rc 0) 00000100:00100000:2.0:1788813167.973174:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313313920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813167.974057:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813167.977711:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12328:x1875706301730048:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 13817us (14234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813167.977726:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 182 00000100:00100000:1.0:1788813167.978074:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313313920 00000100:00100000:1.0:1788813167.978088:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313313920 00000100:00100000:1.0:1788813167.978165:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788813167.978176:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894365bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1875706313313920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813167.978221:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788813167.986301:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313314048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813167.986424:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813167.986507:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313314048 00000100:00100000:2.0:1788813167.986518:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313314048 00000100:00100000:2.0:1788813167.986586:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788813167.986598:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313314048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788813167.986630:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788813167.986684:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313314048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813167.986691:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1788813167.986739:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813167.995197:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313314048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813167.997487:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813167.997525:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301730432 00000100:00100000:3.0:1788813167.997534:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301730432 00000100:00100000:3.0:1788813167.997585:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 48 00000100:00100000:3.0:1788813167.997595:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12328:x1875706301730432:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:3.0:1788813167.997871:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:12328:x1875706301730432:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 277us (393us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788813167.997879:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 48 00000100:00100000:1.0:1788813167.999340:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894365bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1875706313313920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 21158us (25277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813167.999352:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788813167.999605:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313313920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813168.001397:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813168.001700:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301730560 00000100:00100000:0.0:1788813168.001710:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301730560 00000100:00100000:0.0:1788813168.001782:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:0.0:1788813168.001794:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:12328:x1875706301730560:12345-192.168.202.13@tcp:103:lfs.0 00010000:00010000:0.0:1788813168.001809:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788813168.001849:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff7035ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729928 expref: 22 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.001873:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703651 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072993d expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.001886:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7034ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298e2 expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.001908:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:0.0:1788813168.001914:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813168.001986:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:12328:x1875706301730560:12345-192.168.202.13@tcp:103:lfs.0 Request processed in 195us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813168.001993:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00080000:2.0:1788813168.002272:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813168.004161:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813168.004439:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301730688 00000100:00100000:2.0:1788813168.004451:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301730688 00000100:00100000:2.0:1788813168.004515:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 183 00000100:00100000:2.0:1788813168.004525:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:12328:x1875706301730688:12345-192.168.202.13@tcp:58:lfs.0 00010000:00010000:2.0:1788813168.004638:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70366d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.004656:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70366d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.004667:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70366d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813168.004758:0:9156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788813168.004833:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:12328:x1875706301730688:12345-192.168.202.13@tcp:58:lfs.0 Request processed in 309us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813168.004841:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 183 00000100:00100000:3.0:1788813168.030398:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813168.030531:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301730816 00000100:00100000:2.0:1788813168.030549:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301730816 00000100:00100000:2.0:1788813168.030672:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 184 00000100:00100000:2.0:1788813168.030680:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:12330:x1875706301730816:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813168.030697:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813168.030714:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703674 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072994b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.030785:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff70367b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.030796:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff70367b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.030804:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff70367b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.030813:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703682 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.030817:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.030821:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.030879:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703689 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.030884:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.030888:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813168.031114:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788813168.031119:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788813168.031138:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031161:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031237:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff70367b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031246:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff70367b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031253:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff70367b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031260:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813168.031264:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff70367b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031273:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff70367b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031285:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:2.0:1788813168.031288:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813168.031293:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff70367b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031299:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff70367b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031395:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031403:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703682 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031416:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703682 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031421:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813168.031424:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703682 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031430:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703682 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031439:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948943001200) 00010000:00010000:2.0:1788813168.031441:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813168.031445:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703682 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031451:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703682 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031484:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703674 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072994b expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031498:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703689 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072994b expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.031505:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:2.0:1788813168.031507:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813168.031510:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09000, rc 0) 00000100:00100000:2.0:1788813168.031579:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:12330:x1875706301730816:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 898us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813168.031595:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 184 00000100:00100000:3.0:1788813168.484239:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313314176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813168.484340:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813168.484563:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313314176 00000100:00100000:2.0:1788813168.484575:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313314176 00000100:00100000:2.0:1788813168.484643:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788813168.484655:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313314176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813168.484704:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788813168.484766:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313314176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813168.484850:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313314176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813168.485143:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000040:00080000:2.0:1788813168.549848:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813168.549863:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813168.549906:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:2.0:1788813168.549918:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813168.551199:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875706313314304:192.168.202.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788813168.551316:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943382180 going to sleep for 11 seconds 00000100:00100000:1.0:1788813168.559422:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813168.559473:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301730944 00000100:00100000:1.0:1788813168.559487:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301730944 00000100:00100000:1.0:1788813168.559560:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 185 00000100:00100000:1.0:1788813168.559573:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12341:x1875706301730944:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788813168.559621:0:12571:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788813168.559779:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12341:x1875706301730944:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 Request processed in 208us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813168.559787:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 185 00000100:00100000:0.0:1788813168.560118:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875706313314304:192.168.202.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788813168.572084:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813168.572263:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301731072 00000100:00100000:0.0:1788813168.572276:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301731072 00000100:00100000:0.0:1788813168.572349:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 186 00000100:00100000:0.0:1788813168.572360:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:12341:x1875706301731072:12345-192.168.202.13@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788813168.572457:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703690 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.572480:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703690 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.572495:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703690 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.572523:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703697 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.572531:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703697 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.572538:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703697 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.572575:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff70369e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.572585:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff70369e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.572680:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff70369e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813168.572743:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788813168.572749:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813168.572766:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff70369e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.572779:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703690 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.572786:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703690 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.572794:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703690 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.572810:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813168.572815:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703690 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.572824:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703690 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.572839:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6fe40300) 00010000:00010000:0.0:1788813168.572843:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813168.572850:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703690 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.573031:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703690 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.573046:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703697 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.573053:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703697 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.573058:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703697 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.573063:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdaa00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813168.573066:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703697 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.573072:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703697 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.573089:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff948a74a15600) 00010000:00010000:0.0:1788813168.573092:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813168.573095:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703697 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.573102:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703697 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.573118:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff70369e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.573125:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff70369e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.573130:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff70369e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.573135:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813168.573138:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff70369e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.573143:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff70369e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.573149:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:0.0:1788813168.573151:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813168.573154:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff70369e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.573159:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff70369e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813168.573271:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:12341:x1875706301731072:12345-192.168.202.13@tcp:34:lhsmtool_posix.0 Request processed in 910us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813168.573280:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 186 00000100:00100000:0.0:1788813168.589128:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813168.593765:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301731328 00000100:00100000:2.0:1788813168.593788:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301731328 00000100:00100000:2.0:1788813168.594201:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 187 00000100:00100000:2.0:1788813168.594216:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:12341:x1875706301731328:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813168.594248:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813168.594277:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729952 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.594429:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.594447:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.594479:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813168.594492:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788813168.597259:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.597282:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.597290:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.597297:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813168.597303:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.597311:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.597335:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:2.0:1788813168.597339:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813168.597346:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.597353:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.597430:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036a5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729952 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.597468:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6fe40300) 00010000:00010000:2.0:1788813168.597471:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813168.597475:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729952 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.597486:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08800, rc 0) 00000100:00100000:2.0:1788813168.601005:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12341:x1875706301731328:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 6773us (11874us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1788813168.601022:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 187 00000100:00100000:0.0:1788813168.622450:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813168.623372:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301731456 00000100:00100000:1.0:1788813168.623387:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301731456 00000100:00100000:1.0:1788813168.623470:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 188 00000100:00100000:1.0:1788813168.623482:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12341:x1875706301731456:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788813168.623541:0:9156:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788813168.624360:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12341:x1875706301731456:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 Request processed in 876us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813168.624372:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 188 00010000:00010000:1.0:1788813168.624410:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813168.635392:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813168.635469:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301731712 00000100:00100000:3.0:1788813168.635482:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301731712 00000100:00100000:3.0:1788813168.635863:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 189 00000100:00100000:3.0:1788813168.635878:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12341:x1875706301731712:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813168.635916:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813168.635921:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788813168.635983:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff703666 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729944 expref: 21 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.636007:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:3.0:1788813168.636013:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813168.636031:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7036ba lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729959 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788813168.636606:0:6495:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788813168.637313:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7036c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.637333:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7036c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.637346:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7036c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.637429:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7036ba lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729959 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.637463:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7036c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729959 expref: 22 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.637472:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948a764be200) 00010000:00010000:3.0:1788813168.637476:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813168.637479:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657200, rc 0) 00000100:00100000:3.0:1788813168.637573:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:12341:x1875706301731712:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 1698us (2192us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788813168.637582:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 189 00000100:00100000:3.0:1788813168.650059:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813168.652053:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301731968 00000100:00100000:0.0:1788813168.652074:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301731968 00000100:00100000:2.0:1788813168.652223:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 190 00000100:00100000:2.0:1788813168.652237:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:12341:x1875706301731968:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788813168.652315:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813168.652348:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff7036c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729959 expref: 22 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652369:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948a764be200) 00010000:00010000:2.0:1788813168.652382:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813168.652413:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652430:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652442:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652722:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x5f70b525 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652746:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5f70b525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652759:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5f70b525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652813:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652822:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036cf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652829:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652835:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813168.652839:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652847:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652860:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:2.0:1788813168.652864:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813168.652869:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036cf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652876:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652921:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5f70b525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652927:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036d6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5f70b525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652987:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5f70b525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.652993:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813168.652996:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5f70b525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.653003:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036d6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5f70b525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.653013:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x5f70b525 (ffff948943001200) 00010000:00010000:2.0:1788813168.653016:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813168.653019:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036d6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x5f70b525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.653025:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036d6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x5f70b525 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813168.653359:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12341:x1875706301731968:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 1112us (3303us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788813168.653369:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 190 00000100:00100000:0.0:1788813168.668865:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813168.669156:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301732096 00000100:00100000:2.0:1788813168.669167:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301732096 00000100:00100000:2.0:1788813168.669228:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 191 00000100:00100000:2.0:1788813168.669252:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12341:x1875706301732096:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813168.669273:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813168.669295:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729960 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.669331:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.669345:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.669369:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.669496:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff7036dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729960 expref: 23 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.669525:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729960 expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.669534:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948943001200) 00010000:00010000:2.0:1788813168.669538:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788813168.669542:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08800, rc 0) 00000100:00100000:2.0:1788813168.669608:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:12341:x1875706301732096:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 358us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813168.669616:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 191 00000100:00100000:2.0:1788813168.682301:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813168.682394:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301732352 00000100:00100000:1.0:1788813168.682408:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301732352 00000100:00100000:1.0:1788813168.682483:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 192 00000100:00100000:1.0:1788813168.682496:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:12341:x1875706301732352:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788813168.682612:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7036eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.682633:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7036eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.682648:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7036eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788813168.682884:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788813168.682907:0:6495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321701974707ns, next at 322701971112ns, rc = 0 00000004:00010000:1.0:1788813168.682998:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000665cc815 reply state 00000000e3b8239b transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7036eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.683014:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7036eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.683023:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948943001200) 00010000:00010000:1.0:1788813168.683027:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788813168.683032:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788813168.683154:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:12341:x1875706301732352:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 659us (866us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788813168.683163:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 192 00000100:00100000:2.0:1788813168.685713:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813168.685769:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301732480 00000100:00100000:3.0:1788813168.685839:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301732480 00000100:00100000:3.0:1788813168.685923:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 193 00000100:00100000:3.0:1788813168.685982:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:12341:x1875706301732480:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813168.686012:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813168.686038:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7036f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729967 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.686109:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7036f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729967 expref: 25 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.686125:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7036f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729967 expref: 25 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.686146:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948943001200) 00010000:00010000:3.0:1788813168.686157:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813168.686161:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657a00, rc 0) 00000100:00100000:3.0:1788813168.686245:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:12341:x1875706301732480:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 310us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813168.686254:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 193 00000100:00100000:1.0:1788813168.688158:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813168.688274:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301732608 00000100:00100000:2.0:1788813168.688292:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301732608 00000100:00080000:3.0:1788813168.688340:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813168.688368:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 59 00000100:00100000:2.0:1788813168.688378:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2396:x1875706301732608:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788813168.688618:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301732608:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 Request processed in 241us (467us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788813168.688627:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 59 00000100:00100000:3.0:1788813168.693527:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813168.693811:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301732864 00000100:00100000:1.0:1788813168.693825:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301732864 00000100:00100000:1.0:1788813168.694142:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 49 00000100:00100000:1.0:1788813168.694153:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:12341:x1875706301732864:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788813168.694447:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+26:12341:x1875706301732864:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 295us (932us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1788813168.694455:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 49 00000100:00100000:3.0:1788813168.697252:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813168.697464:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301733120 00000100:00100000:1.0:1788813168.697475:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301733120 00000100:00100000:1.0:1788813168.697564:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 194 00000100:00100000:1.0:1788813168.697574:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+26:12341:x1875706301733120:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788813168.697695:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+26:12341:x1875706301733120:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 123us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813168.697700:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 194 00000100:00100000:3.0:1788813168.704330:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813168.704794:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301733248 00000100:00100000:0.0:1788813168.704808:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301733248 00000100:00100000:0.0:1788813168.704905:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 195 00000100:00100000:0.0:1788813168.704918:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+26:12341:x1875706301733248:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813168.704974:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813168.705342:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff7036f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072996e expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.705457:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703700 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.705477:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703700 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.705490:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703700 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813168.705550:0:9156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813168.705572:0:9156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703700 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.706167:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff7036f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072996e expref: 28 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.706190:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703700 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072996e expref: 27 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.706199:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948943001200) 00010000:00010000:0.0:1788813168.706202:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788813168.706207:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166fc00, rc 0) 00000100:00100000:0.0:1788813168.706293:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:12341:x1875706301733248:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 1377us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813168.706302:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 195 00000100:00100000:2.0:1788813168.711627:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813168.711742:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301733376 00000100:00100000:0.0:1788813168.711755:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301733376 00000100:00100000:0.0:1788813168.711831:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 60 00000100:00100000:0.0:1788813168.711844:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301733376:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813168.711878:0:14190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813168.711914:0:14190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061f55f08/0xf32533d6ff703707 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729975 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813168.711980:0:14190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f1f71, blocks: 0x0 00010000:00010000:0.0:1788813168.712018:0:14190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1788813168.712024:0:14190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813168.712036:0:14190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061f55f08/0xf32533d6ff703707 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729975 expref: 8 pid: 14190 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.712078:0:14190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061f55f08/0xf32533d6ff703707 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729975 expref: 8 pid: 14190 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.712093:0:14190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f600, rc 0) 00000100:00100000:0.0:1788813168.712164:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2396:x1875706301733376:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 323us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813168.712172:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 60 00000100:00100000:0.0:1788813168.714806:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813168.714907:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301733632 00000100:00100000:3.0:1788813168.714919:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301733632 00000100:00100000:3.0:1788813168.715029:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 196 00000100:00100000:3.0:1788813168.715042:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:12341:x1875706301733632:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788813168.715176:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:12341:x1875706301733632:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 135us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813168.715183:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 196 00000100:00100000:1.0:1788813168.719502:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813168.719973:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301733760 00000100:00100000:0.0:1788813168.719987:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301733760 00000100:00100000:0.0:1788813168.720062:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 61 00000100:00100000:0.0:1788813168.720075:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:12341:x1875706301733760:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813168.720109:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813168.720135:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000107f7a94/0xf32533d6ff70370e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072997c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.720177:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061f55f08/0xf32533d6ff703707 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729975 expref: 9 pid: 14190 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.720187:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813168.720193:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813168.720199:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000107f7a94/0xf32533d6ff70370e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072997c expref: 9 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.720254:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061f55f08/0xf32533d6ff703707 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729975 expref: 9 pid: 14190 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.720278:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061f55f08/0xf32533d6ff703707 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729975 expref: 9 pid: 14190 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813168.720295:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1875706313314432:192.168.202.13@tcp:104: 00000100:00100000:0.0:1788813168.720405:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943613b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813168.723994:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813168.724083:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301733888 00000100:00100000:1.0:1788813168.724094:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301733888 00010000:00010000:1.0:1788813168.724155:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061f55f08/0xf32533d6ff703707 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729975 expref: 10 pid: 14190 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813168.724212:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 86 00000100:00100000:1.0:1788813168.724223:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+10:2396:x1875706301733888:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813168.724241:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813168.724269:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061f55f08/0xf32533d6ff703707 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729975 expref: 10 pid: 14190 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.724283:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061f55f08/0xf32533d6ff703707 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729975 expref: 10 pid: 14190 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.724322:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813168.724327:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813168.724336:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000107f7a94/0xf32533d6ff70370e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072997c expref: 10 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.724347:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000107f7a94/0xf32533d6ff70370e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072997c expref: 10 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.724392:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000107f7a94/0xf32533d6ff70370e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072997c expref: 10 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813168.724409:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6480:1875706313314560:192.168.202.13@tcp:105: 00000100:00100000:1.0:1788813168.724498:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72ab40 going to sleep for 11 seconds 00010000:00010000:0.0:1788813168.725849:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061f55f08/0xf32533d6ff703707 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729975 expref: 10 pid: 14190 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813168.725879:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1875706313314432:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813168.725920:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000107f7a94/0xf32533d6ff70370e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a072997c expref: 9 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.725955:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f400, rc 0) 00000100:00100000:0.0:1788813168.726035:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:12341:x1875706301733760:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 5955us (6535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813168.726047:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 61 00000040:00080000:1.0:1788813168.744120:0:14624:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788813168.744131:0:14624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813168.744158:0:14624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:1.0:1788813168.744165:0:14624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813168.752294:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813168.752375:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6480:1875706313314560:192.168.202.13@tcp:105: 00010000:00010000:1.0:1788813168.752408:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813168.752548:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2396:x1875706301733888:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 28324us (28575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813168.752560:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 86 00000100:00100000:0.0:1788813168.752669:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301734016 00000100:00100000:0.0:1788813168.752677:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301734016 00002000:00100000:0.0:1788813168.752729:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff94894349a680 x1875706301734016/t0(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:739/0 lens 504/0 e 0 to 0 dl 1788813179 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813168.752737:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94894349a680 with x1875706301734016 ext(0->8) 00002000:00010000:0.0:1788813168.752742:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94894349a680 00000100:00100000:0.0:1788813168.752769:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4 00000100:00100000:0.0:1788813168.752792:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894349a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2397:x1875706301734016:12345-192.168.202.13@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788813168.758001:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894349a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+10:2397:x1875706301734016:12345-192.168.202.13@tcp:4:lhsmtool_posix.0 Request processed in 5199us (5703us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788813168.758021:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4 00002000:00100000:3.0:1788813168.758035:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff94894349a680 x1875706301734016/t4294967315(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:739/0 lens 504/448 e 0 to 0 dl 1788813179 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788813168.758045:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94894349a680 with x1875706301734016 ext(0->8) 00002000:00010000:3.0:1788813168.758052:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94894349a680 00000100:00100000:2.0:1788813168.767315:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813168.767564:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301734144 00000100:00100000:1.0:1788813168.767577:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301734144 00000100:00100000:1.0:1788813168.767644:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 197 00000100:00100000:1.0:1788813168.767660:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:12341:x1875706301734144:12345-192.168.202.13@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788813168.770300:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1788813168.770318:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788813168.770350:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:0.0:1788813168.770396:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7036eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.770408:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7036eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.770416:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7036eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.770423:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813168.770428:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7036eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.770437:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7036eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.770453:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948943001200) 00010000:00010000:0.0:1788813168.770456:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788813168.770462:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7036eb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.770468:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7036eb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788813168.770574:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788813168.770584:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788813168.770591:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813168.770620:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313314688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788813168.770701:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813168.771924:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:12341:x1875706301734144:12345-192.168.202.13@tcp:44:lhsmtool_posix.0 Request processed in 4254us (4615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813168.771954:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 197 00000100:00100000:3.0:1788813168.774979:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813168.775072:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313314688 00000100:00100000:0.0:1788813168.775089:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313314688 00000100:00100000:0.0:1788813168.775178:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301734272 00000100:00100000:0.0:1788813168.775181:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301734272 00000100:00100000:0.0:1788813168.775213:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788813168.775222:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313314688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788813168.775387:0:14190:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788813168.775392:0:14190:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788813169 00002000:00010000:0.0:1788813168.775394:0:14190:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788813168.775397:0:14190:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788813169 -> 1788813169 00002000:00010000:0.0:1788813168.775399:0:14190:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788813168.775471:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3625:x1875706313314688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 251us (4770us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788813168.775478:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788813168.775501:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:0.0:1788813168.775509:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+10:2399:x1875706301734272:12345-192.168.202.13@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1788813168.775764:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9489441a5180/2, rc 0, transno 4294967316 00000100:00100000:0.0:1788813168.775771:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313314688:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788813168.775824:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788813168.788360:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1788813168.788381:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788813168.788692:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2399:x1875706301734272:12345-192.168.202.13@tcp:16:lhsmtool_posix.0 Request processed in 13174us (13718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813168.788707:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:0.0:1788813168.791563:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813168.792403:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301734528 00000100:00100000:1.0:1788813168.792418:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301734528 00000100:00100000:1.0:1788813168.792483:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 198 00000100:00100000:1.0:1788813168.792494:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:12341:x1875706301734528:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788813168.792547:0:9156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813168.792574:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703700 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072996e expref: 19 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.792592:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948943001200) 00010000:00010000:1.0:1788813168.792597:0:9156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813168.792628:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff703715 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.792642:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff703715 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.792653:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff703715 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813168.792776:0:9156:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ced5fb3 reply state 000000001e45a1fd transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff703715 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.792789:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff703715 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.792796:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948943001200) 00010000:00010000:1.0:1788813168.792798:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788813168.792801:0:9156:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788813168.792983:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:12341:x1875706301734528:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 439us (1378us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1788813168.792992:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 198 00000100:00100000:1.0:1788813168.796152:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813168.796528:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301734656 00000100:00100000:0.0:1788813168.796544:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301734656 00000100:00100000:0.0:1788813168.796624:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 64 00000100:00100000:0.0:1788813168.796639:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2397:x1875706301734656:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788813168.797218:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788813168.797223:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788813169 -> 1788813168 00002000:00010000:0.0:1788813168.797225:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788813166 00002000:00010000:0.0:1788813168.797227:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788813169 -> 1788813168 00002000:00010000:0.0:1788813168.797229:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788813168.797411:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2397:x1875706301734656:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 Request processed in 774us (1265us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788813168.797420:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 64 00000100:00100000:3.0:1788813168.799609:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813168.799662:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301734912 00000100:00100000:0.0:1788813168.799674:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301734912 00000100:00100000:0.0:1788813168.799740:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 199 00000100:00100000:0.0:1788813168.799749:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:12341:x1875706301734912:12345-192.168.202.13@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788813168.799927:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70371c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.799963:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729960 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.799971:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70371c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.800015:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729960 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.800036:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729960 expref: 20 pid: 6496 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813168.800074:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313314816:192.168.202.13@tcp:104: 00000100:00100000:0.0:1788813168.800195:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943613b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813168.802150:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313314816:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813168.802186:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70371c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813168.802596:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813168.802796:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301735040 00000100:00100000:0.0:1788813168.802806:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301735040 00010000:00010000:0.0:1788813168.802848:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729960 expref: 21 pid: 6496 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813168.802908:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 87 00000100:00100000:0.0:1788813168.802920:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:2396:x1875706301735040:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813168.802960:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813168.802969:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729960 expref: 21 pid: 6496 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.802983:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729960 expref: 21 pid: 6496 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.803010:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7036e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729960 expref: 21 pid: 6496 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.803031:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948943001200) 00010000:00010000:0.0:1788813168.803038:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70371c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.803063:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70371c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.803072:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70371c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.803296:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813168.803368:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:2396:x1875706301735040:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 449us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813168.803377:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 87 00010000:00010000:3.0:1788813168.803747:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70371c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.803754:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70371c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.803802:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70371c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.803809:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70371c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.803817:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70371c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.803824:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813168.803830:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70371c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.803838:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70371c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.803849:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948943001200) 00010000:00010000:3.0:1788813168.803853:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788813168.803867:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70371c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.803874:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70371c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813168.804000:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:12341:x1875706301734912:12345-192.168.202.13@tcp:55:lhsmtool_posix.0 Request processed in 4250us (4400us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788813168.804011:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 199 00000100:00100000:3.0:1788813168.806446:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813168.806518:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301735168 00000100:00100000:1.0:1788813168.806527:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301735168 00000100:00100000:1.0:1788813168.806585:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:1.0:1788813168.806594:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2396:x1875706301735168:12345-192.168.202.13@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788813168.806644:0:10066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff703723 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.806664:0:10066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000107f7a94/0xf32533d6ff70370e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a072997c expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.806671:0:10066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813168.806675:0:10066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813168.806679:0:10066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff703723 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.806711:0:10066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000107f7a94/0xf32533d6ff70370e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.13@tcp remote: 0x709a1244a072997c expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.806722:0:10066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000107f7a94/0xf32533d6ff70370e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a072997c expref: 8 pid: 8405 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813168.806736:0:10066:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10066:1875706313314944:192.168.202.13@tcp:104: 00000100:00100000:1.0:1788813168.806876:0:10066:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813168.809319:0:10066:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10066:1875706313314944:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813168.809356:0:10066:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff703723 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813168.810390:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813168.810474:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301735296 00000100:00100000:1.0:1788813168.810482:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301735296 00010000:00010000:1.0:1788813168.810526:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000107f7a94/0xf32533d6ff70370e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a072997c expref: 9 pid: 8405 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813168.810567:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 88 00000100:00100000:1.0:1788813168.810574:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50683850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2396:x1875706301735296:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813168.810590:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813168.810615:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000107f7a94/0xf32533d6ff70370e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a072997c expref: 9 pid: 8405 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.810626:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000107f7a94/0xf32533d6ff70370e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a072997c expref: 9 pid: 8405 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.810656:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000107f7a94/0xf32533d6ff70370e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a072997c expref: 9 pid: 8405 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.810676:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813168.810681:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813168.810688:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff703723 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.810717:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff703723 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.810755:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813168.810822:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50683850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2396:x1875706301735296:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 247us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813168.810831:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 88 00010000:00010000:0.0:1788813168.810965:0:10066:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff703723 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.810977:0:10066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff703723 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.811000:0:10066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff703723 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.811010:0:10066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff703723 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.811019:0:10066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff703723 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.811036:0:10066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813168.811041:0:10066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff703723 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.811061:0:10066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff703723 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.811075:0:10066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff703723 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.811081:0:10066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008ac14d0/0xf32533d6ff703723 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813168.811247:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301735168:12345-192.168.202.13@tcp:1:lhsmtool_posix.0 Request processed in 4652us (4811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813168.811255:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:1.0:1788813168.819752:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813168.819969:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301735552 00000100:00100000:3.0:1788813168.820092:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301735552 00000100:00100000:3.0:1788813168.820362:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 200 00000100:00100000:3.0:1788813168.820376:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:12341:x1875706301735552:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788813168.820483:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff70372a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.820506:0:12571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703571 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729905 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.820517:0:12571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff70372a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.820562:0:12571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703571 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729905 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.820578:0:12571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703571 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729905 expref: 19 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813168.820613:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313315072:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813168.820717:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813168.824387:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813168.824461:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301735680 00000100:00100000:2.0:1788813168.824474:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301735680 00010000:00010000:2.0:1788813168.824527:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703571 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729905 expref: 20 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813168.824579:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 89 00000100:00100000:2.0:1788813168.824603:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:2397:x1875706301735680:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813168.824623:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813168.824632:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703571 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729905 expref: 20 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.824647:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703571 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729905 expref: 20 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.824676:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:2.0:1788813168.824684:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff70372a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.824708:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff70372a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.824718:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff70372a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.824746:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813168.824815:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944239c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:2397:x1875706301735680:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 215us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813168.824823:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 89 00010000:00010000:3.0:1788813168.826346:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703571 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729905 expref: 19 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813168.826371:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313315072:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813168.826399:0:12571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff70372a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.826409:0:12571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff70372a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.826415:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff70372a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.826720:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703731 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.826736:0:12571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7036f2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729967 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.826746:0:12571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703731 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.826789:0:12571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7036f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729967 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.826810:0:12571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7036f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729967 expref: 19 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813168.826835:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313315200:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813168.827391:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813168.830743:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813168.830874:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313315200:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813168.830915:0:12571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703731 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813168.831358:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301735808 00000100:00100000:2.0:1788813168.831369:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301735808 00010000:00010000:2.0:1788813168.831416:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7036f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729967 expref: 20 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813168.831508:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 90 00000100:00100000:2.0:1788813168.831520:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:2397:x1875706301735808:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813168.831538:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813168.831546:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7036f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729967 expref: 20 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.831561:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7036f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729967 expref: 20 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.831600:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7036f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729967 expref: 20 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.831628:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948943001200) 00010000:00010000:2.0:1788813168.831634:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703731 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.831644:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703731 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.831653:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703731 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.831686:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813168.831755:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:2397:x1875706301735808:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 236us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813168.831763:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 90 00010000:00010000:3.0:1788813168.831817:0:12571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703731 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.831826:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703731 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813168.832012:0:12571:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1788813168.832369:0:12571:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1788813168.832415:0:12571:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1788813168.832517:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12571:1875706313315328:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788813168.832652:0:12571:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813168.832694:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4840 going to sleep for 11 seconds 00000100:00100000:3.0:1788813168.832726:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313315328 00000100:00100000:3.0:1788813168.832733:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313315328 00000100:00100000:3.0:1788813168.832776:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788813168.832784:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12571:x1875706313315328:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788813168.833001:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12571:x1875706313315328:12345-0@lo:1000:mdt00_004.0 Request processed in 217us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813168.833009:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788813168.833350:0:12571:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1788813168.833363:0:12571:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9489441a5180, transno 4294967316 00000100:00100000:3.0:1788813168.833381:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12571:1875706313315328:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788813168.833530:0:12571:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1788813168.833653:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12571:1875706313315456:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788813168.833701:0:12571:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813168.833728:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788813168.835483:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313315456 00000100:00100000:2.0:1788813168.835498:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313315456 00000100:00100000:2.0:1788813168.835603:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788813168.835615:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12571:x1875706313315456:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788813168.835860:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12571:x1875706313315456:12345-0@lo:1000:mdt00_004.0 Request processed in 239us (2149us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788813168.835868:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788813168.835990:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12571:1875706313315456:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1788813168.836055:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703731 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836068:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703731 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836077:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703731 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836083:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813168.836089:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703731 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836109:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703731 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836130:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948943001200) 00010000:00010000:1.0:1788813168.836141:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813168.836150:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703731 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836156:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703731 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836186:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70366d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836193:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70366d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836200:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70366d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836205:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813168.836208:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70366d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836214:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70366d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836223:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:1.0:1788813168.836225:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813168.836229:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70366d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836235:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08200/0xf32533d6ff70366d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836262:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff703738 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836288:0:12571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703689 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072994b expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836298:0:12571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff703738 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836341:0:12571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703689 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072994b expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.836358:0:12571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703689 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072994b expref: 22 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813168.836373:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313315584:192.168.202.13@tcp:104: 00000100:00100000:1.0:1788813168.836459:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813168.840395:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813168.840433:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301735936 00000100:00100000:0.0:1788813168.840446:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301735936 00010000:00010000:0.0:1788813168.840494:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703689 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072994b expref: 23 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813168.840537:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 91 00000100:00100000:0.0:1788813168.840548:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+23:2397:x1875706301735936:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813168.840566:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813168.840573:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703689 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072994b expref: 23 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.840588:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703689 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072994b expref: 23 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.840622:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:0.0:1788813168.840628:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff703738 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.840640:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff703738 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.840649:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff703689 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072994b expref: 23 pid: 6494 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.840649:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff703738 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813168.840665:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313315584:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813168.840672:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813168.840690:0:12571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff703738 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.840699:0:12571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff703738 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.840705:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff703738 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.840719:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff703738 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.840732:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff703738 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813168.840735:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:2397:x1875706301735936:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 189us (352us total) trans 0 rc 0/0 00010000:00010000:1.0:1788813168.840740:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff703738 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813168.840743:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 91 00010000:00010000:1.0:1788813168.840747:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813168.840753:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff703738 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.840761:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff703738 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.840771:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:1.0:1788813168.840774:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813168.840779:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff703738 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.840785:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff703738 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.840796:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff70372a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.840803:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff70372a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.840809:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff70372a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.840813:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813168.840822:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff70372a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.840828:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff70372a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.840838:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a455ee500) 00010000:00010000:1.0:1788813168.840841:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788813168.840843:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff70372a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813168.840862:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff70372a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813168.841069:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12341:x1875706301735552:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 20697us (21330us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788813168.841079:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 200 00000020:00080000:1.0:1788813168.841083:0:12571:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788813168.841396:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813168.841401:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813168.842483:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788813168.842499:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788813168.844358:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813168.844450:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301736192 00000100:00100000:3.0:1788813168.844463:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301736192 00000100:00100000:3.0:1788813168.844560:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 50 00000100:00100000:3.0:1788813168.844572:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a612cfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12341:x1875706301736192:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788813168.845273:0:6498:0:(mdd_object.c:4199:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788813168.845321:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1788813168.845365:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff70373f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.845386:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff70373f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.845402:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff70373f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.845412:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff70373f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.845419:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff70373f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.845426:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff70373f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.845468:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788813168.845578:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a612cfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+23:12341:x1875706301736192:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 1006us (1231us total) trans 4294967470 rc 0/0 00010000:00010000:0.0:1788813168.845754:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813168.845763:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff70373f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.845772:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813168.845777:0:7900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff70373f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.845787:0:7900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff70373f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.845804:0:7900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948943001200) 00010000:00010000:0.0:1788813168.845814:0:7900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788813168.845821:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff70373f lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.845828:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff70373f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.845843:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813168.845845:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813168.845847:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813168.846178:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 50 00000020:00080000:3.0:1788813168.846187:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788813169.636574:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813169.636910:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788813170.049033:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813170.049279:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813170.049369:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301736320 00000100:00100000:2.0:1788813170.049389:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301736320 00000100:00100000:3.0:1788813170.049451:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813170.049549:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813170.049671:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 379 00000100:00100000:2.0:1788813170.049686:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2396:x1875706301736320:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813170.049731:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813170.049758:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301736832 00000100:00100000:0.0:1788813170.049767:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301736832 00000100:00100000:0.0:1788813170.049826:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 119 00000100:00100000:0.0:1788813170.049847:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301736832:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813170.049913:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301736576 00000100:00100000:1.0:1788813170.049918:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301736576 00000100:00100000:1.0:1788813170.049986:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301737088 00000100:00100000:1.0:1788813170.049989:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301737088 00000100:00100000:1.0:1788813170.050016:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 301 00000100:00100000:1.0:1788813170.050023:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301736576:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813170.050090:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2396:x1875706301736320:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 405us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813170.050177:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 379 00000100:00100000:0.0:1788813170.050296:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301736832:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 458us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813170.051551:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301736576:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 1523us (2267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813170.051564:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 301 00000100:00100000:1.0:1788813170.051598:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301736448 00000100:00100000:1.0:1788813170.051614:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301736448 00000100:00100000:1.0:1788813170.051641:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 302 00000100:00100000:1.0:1788813170.051649:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301737088:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813170.051698:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301737088:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 50us (2149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813170.051705:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 302 00000100:00100000:1.0:1788813170.051717:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 303 00000100:00100000:1.0:1788813170.051723:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+23:2396:x1875706301736448:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813170.051753:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+23:2396:x1875706301736448:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 31us (2026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813170.051759:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 303 00000100:00100000:0.0:1788813170.051999:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 119 00000100:00080000:2.0:1788813170.053818:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813170.053827:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788813170.053846:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813170.054009:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813170.054093:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813170.054145:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301736704 00000100:00100000:1.0:1788813170.054154:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301736704 00000100:00100000:0.0:1788813170.054252:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301736960 00000100:00100000:1.0:1788813170.054256:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 120 00000100:00100000:0.0:1788813170.054257:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301736960 00000100:00100000:0.0:1788813170.054287:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 304 00000100:00100000:0.0:1788813170.054294:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301736960:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813170.054319:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301736704:12345-192.168.202.13@tcp:400:kworker.0 00000100:00080000:2.0:1788813170.054372:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813170.054376:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813170.054446:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301736704:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 181us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813170.054454:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 120 00000100:00100000:0.0:1788813170.054788:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301736960:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 493us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813170.054795:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 304 00010000:00010000:1.0:1788813170.667134:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813170.700988:0:14675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813170.700998:0:14675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813170.701032:0:14675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:0.0:1788813170.701046:0:14675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813170.870234:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813170.873843:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301737344 00000100:00100000:0.0:1788813170.873856:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301737344 00000100:00100000:0.0:1788813170.873929:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 201 00000100:00100000:0.0:1788813170.873957:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+23:12359:x1875706301737344:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813170.873976:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813170.873998:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703746 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729983 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.874781:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70374d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.874799:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70374d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.874812:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70374d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813170.874823:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788813170.874976:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703746 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729983 expref: 26 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.874999:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70374d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729983 expref: 25 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.875008:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:0.0:1788813170.875012:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788813170.875016:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f000, rc 0) 00000100:00100000:0.0:1788813170.875238:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:12359:x1875706301737344:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 1282us (5014us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788813170.875263:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 201 00000100:00100000:0.0:1788813170.898198:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813170.898694:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301737472 00000100:00100000:1.0:1788813170.898705:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301737472 00000100:00100000:1.0:1788813170.898765:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 202 00000100:00100000:1.0:1788813170.898777:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:12359:x1875706301737472:12345-192.168.202.13@tcp:34:lfs.0 00010000:00010000:1.0:1788813170.898850:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff70375b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.898891:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff70375b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.898902:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff70375b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.898918:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703762 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.898925:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703762 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.898951:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703762 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899028:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff703769 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899111:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff703769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899186:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff703769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813170.899229:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff703769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899242:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff70375b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899248:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff70375b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899266:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff70375b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899272:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813170.899276:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff70375b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899283:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff70375b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899494:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:1.0:1788813170.899498:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813170.899504:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff70375b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899511:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff70375b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899524:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703762 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899530:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703762 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899535:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703762 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899539:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dace00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813170.899542:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703762 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899558:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703762 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899566:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a63b32900) 00010000:00010000:1.0:1788813170.899568:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813170.899572:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703762 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899578:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703762 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899592:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff703769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899598:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff703769 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899604:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff703769 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899609:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813170.899612:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff703769 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899618:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff703769 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899625:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a63b32c00) 00010000:00010000:1.0:1788813170.899628:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813170.899630:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff703769 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.899645:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff703769 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813170.899727:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:12359:x1875706301737472:12345-192.168.202.13@tcp:34:lfs.0 Request processed in 951us (1539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813170.899735:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 202 00000040:00080000:0.0:1788813170.916647:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813170.916655:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813170.916739:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788813170.916747:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788813170.969276:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813170.969450:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301737728 00000100:00100000:0.0:1788813170.969465:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301737728 00000100:00100000:0.0:1788813170.969529:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 203 00000100:00100000:0.0:1788813170.969539:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:12362:x1875706301737728:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813170.969558:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813170.969590:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703770 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072998a expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.969662:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703777 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.969676:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703777 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.969686:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703777 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.969706:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70377e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.969714:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70377e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.969720:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70377e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.969844:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703785 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.969852:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703785 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.969858:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703785 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813170.969877:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788813170.969977:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703777 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.969985:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703777 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.969991:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703777 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.969996:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813170.970000:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703777 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.970007:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703777 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.970019:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:0.0:1788813170.970022:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813170.970027:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703777 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.970043:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff703777 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.970056:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70377e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.970063:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70377e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.970068:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70377e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.970073:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813170.970077:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70377e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.970082:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70377e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.970090:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15200) 00010000:00010000:0.0:1788813170.970092:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813170.970095:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70377e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.970100:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff70377e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.970137:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703770 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072998a expref: 28 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.970151:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703785 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072998a expref: 27 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.970164:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:0.0:1788813170.970167:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813170.970170:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f400, rc 0) 00000100:00100000:0.0:1788813170.970239:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:12362:x1875706301737728:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 701us (971us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788813170.970246:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 203 00000100:00100000:1.0:1788813170.975309:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813170.975489:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301737856 00000100:00100000:2.0:1788813170.975500:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301737856 00000100:00100000:2.0:1788813170.975571:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 204 00000100:00100000:2.0:1788813170.975582:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:12362:x1875706301737856:12345-192.168.202.13@tcp:54:lfs.0 00010000:00010000:2.0:1788813170.975650:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703793 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813170.975667:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703793 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813170.975678:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703793 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813170.975716:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703793 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813170.975723:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703793 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813170.975730:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703793 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813170.975736:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813170.975754:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703793 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813170.975762:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703793 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813170.975774:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:2.0:1788813170.975778:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813170.975783:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703793 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813170.975789:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09c00/0xf32533d6ff703793 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813170.975875:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:12362:x1875706301737856:12345-192.168.202.13@tcp:54:lfs.0 Request processed in 285us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813170.975883:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 204 00000100:00100000:3.0:1788813170.981353:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813170.981737:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301738112 00000100:00100000:1.0:1788813170.981748:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301738112 00000100:00100000:1.0:1788813170.981804:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 51 00000100:00100000:1.0:1788813170.981814:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:12362:x1875706301738112:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813170.982060:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+28:12362:x1875706301738112:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 247us (728us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1788813170.982068:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 51 00000100:00100000:0.0:1788813171.044277:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313315968:0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.044363:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813171.044413:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313316480:0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.044438:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813171.044456:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313316992:0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.044476:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813171.044498:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788813171.044504:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313316096:0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.044524:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813171.044541:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313316608:0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.044562:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813171.044578:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313317120:0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.044616:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813171.044653:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313315968 00000100:00100000:0.0:1788813171.044661:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313315968 00000100:00100000:0.0:1788813171.044707:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788813171.044715:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313315968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.044762:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313315968:12345-0@lo:400:kworker.0 Request processed in 48us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813171.044775:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788813171.044796:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313316480 00000100:00100000:0.0:1788813171.044799:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313316480 00000100:00100000:0.0:1788813171.044826:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313316992 00000100:00100000:0.0:1788813171.044828:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313316992 00000100:00100000:0.0:1788813171.044844:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313316096 00000100:00100000:0.0:1788813171.044846:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313316096 00000100:00100000:0.0:1788813171.044856:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788813171.044861:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313316480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.044904:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313316480:12345-0@lo:400:kworker.0 Request processed in 42us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813171.044911:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788813171.044927:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788813171.044963:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313316992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813171.044986:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313315712:0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.044996:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313316992:12345-0@lo:400:kworker.0 Request processed in 58us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813171.045004:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788813171.045014:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788813171.045020:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313316096:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788813171.045140:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788813171.045465:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313315840:0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.045516:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313316096:12345-0@lo:400:kworker.0 Request processed in 497us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813171.045524:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788813171.045546:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313316608 00000100:00100000:0.0:1788813171.045549:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313316608 00000100:00100000:0.0:1788813171.045580:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313317120 00000100:00100000:0.0:1788813171.045583:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313317120 00000100:00100000:0.0:1788813171.045606:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788813171.045623:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489436e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313316608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.045656:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489436e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313316608:12345-0@lo:400:kworker.0 Request processed in 34us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813171.045662:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788813171.045673:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788813171.045678:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313317120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.045703:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313317120:12345-0@lo:400:kworker.0 Request processed in 25us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813171.045709:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788813171.045728:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788813171.045816:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813171.045821:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813171.045873:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313316096:0@lo:400:kworker.0 00000100:00100000:3.0:1788813171.046076:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313316224:0@lo:400:kworker.0 00000100:00100000:3.0:1788813171.046122:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813171.046142:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313316736:0@lo:400:kworker.0 00000100:00100000:3.0:1788813171.046164:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813171.046185:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313317248:0@lo:400:kworker.0 00000100:00100000:3.0:1788813171.046206:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813171.047046:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313316736 00000100:00100000:3.0:1788813171.047054:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313316736 00000100:00100000:3.0:1788813171.047113:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313317248 00000100:00100000:3.0:1788813171.047117:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313317248 00000100:00100000:3.0:1788813171.047166:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788813171.047175:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3627:x1875706313316736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813171.048156:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313316224 00000100:00100000:2.0:1788813171.048169:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313316224 00000100:00100000:2.0:1788813171.048247:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788813171.048257:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313316224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813171.048356:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313316224:12345-0@lo:400:kworker.0 Request processed in 101us (2233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813171.048363:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1788813171.048388:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813171.048393:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813171.048952:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313316608:0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.048971:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313317120:0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.048988:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313315968:0@lo:400:kworker.0 00010000:00080000:0.0:1788813171.049005:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948944026a00 x1875706313316480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813171.049009:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3627:x1875706313316736:12345-0@lo:400:kworker.0 Request processed in 69us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813171.049033:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313316480:0@lo:400:kworker.0 00000100:00100000:3.0:1788813171.049042:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:0.0:1788813171.049063:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489436e6a00 x1875706313316992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813171.049074:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313316992:0@lo:400:kworker.0 00000100:00100000:3.0:1788813171.049085:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788813171.049108:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313317248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.049126:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313317504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813171.049203:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313317248:12345-0@lo:400:kworker.0 Request processed in 107us (2993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813171.049210:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788813171.049241:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313315712 00000100:00100000:3.0:1788813171.049260:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313315712 00000100:00100000:3.0:1788813171.049300:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788813171.049308:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313315712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813171.049347:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313315712:12345-0@lo:400:kworker.0 Request processed in 41us (3623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813171.049355:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788813171.049387:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313315712:0@lo:400:kworker.0 00000100:00100000:2.0:1788813171.049424:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313316224:0@lo:400:kworker.0 00000100:00100000:2.0:1788813171.049437:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313316736:0@lo:400:kworker.0 00000100:00100000:2.0:1788813171.049451:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313317248:0@lo:400:kworker.0 00000100:00100000:2.0:1788813171.049478:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813171.049487:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313317376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813171.049535:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313317632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813171.049667:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813171.049798:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813171.050158:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813171.050180:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313316352:0@lo:400:kworker.0 00000100:00100000:1.0:1788813171.050219:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813171.050234:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313316864:0@lo:400:kworker.0 00000100:00100000:1.0:1788813171.050254:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813171.050279:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313315840 00000100:00100000:1.0:1788813171.050285:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313315840 00000100:00100000:1.0:1788813171.050496:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313316352 00000100:00100000:1.0:1788813171.050501:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313316352 00000100:00100000:3.0:1788813171.050539:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813171.050550:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313316864 00000100:00100000:1.0:1788813171.050556:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313316864 00000100:00100000:1.0:1788813171.050575:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788813171.050583:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313315840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813171.050630:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313315840:12345-0@lo:400:kworker.0 Request processed in 48us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813171.050637:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788813171.050652:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788813171.050658:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313316352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813171.050714:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313317504 00000100:00100000:3.0:1788813171.050723:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313317504 00000100:00100000:3.0:1788813171.050762:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313317376 00000100:00100000:3.0:1788813171.050765:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313317376 00000100:00100000:3.0:1788813171.050780:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788813171.050787:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313317504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788813171.050817:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788813171.050960:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313316352:12345-0@lo:400:kworker.0 Request processed in 300us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813171.050968:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788813171.050984:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788813171.050992:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313316864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813171.051022:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313316864:12345-0@lo:400:kworker.0 Request processed in 33us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813171.051028:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788813171.051100:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313317504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 311us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813171.051122:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788813171.051134:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788813171.051148:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313317376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813171.051166:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923521536 avail 3691999232 00000100:00080000:3.0:1788813171.051179:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813171.051230:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313317376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813171.051237:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788813171.051587:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313317632 00000100:00100000:0.0:1788813171.051594:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313317632 00000100:00100000:0.0:1788813171.051634:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788813171.051641:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313317632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788813171.051667:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788813171.051727:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313317632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813171.051733:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788813171.051783:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313317632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813171.051824:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313317376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813171.051852:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313317504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813171.055575:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313316864:0@lo:400:kworker.0 00000100:00100000:1.0:1788813171.055619:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313315840:0@lo:400:kworker.0 00000100:00100000:1.0:1788813171.055631:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313316352:0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.102616:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813171.111625:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301738368 00000100:00100000:1.0:1788813171.111641:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301738368 00000100:00100000:1.0:1788813171.111802:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 205 00000100:00100000:1.0:1788813171.111813:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+28:11886:x1875706301738368:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:1.0:1788813171.111840:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813171.111952:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff70379a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729991 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.112151:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.112167:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703785 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072998a expref: 29 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.112176:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.112213:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703785 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072998a expref: 29 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.112227:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703785 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072998a expref: 29 pid: 9156 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813171.112240:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489441fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313317760:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813171.114574:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813171.123302:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489441fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313317760:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813171.123334:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813171.124186:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813171.125991:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301738496 00000100:00100000:1.0:1788813171.126007:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301738496 00010000:00010000:1.0:1788813171.126059:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703785 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072998a expref: 30 pid: 9156 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813171.126104:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 92 00000100:00100000:1.0:1788813171.126113:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944171880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:2396:x1875706301738496:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813171.126127:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813171.126134:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703785 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072998a expref: 30 pid: 9156 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.126161:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703785 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072998a expref: 30 pid: 9156 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.126184:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703785 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a072998a expref: 30 pid: 9156 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.126202:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:1.0:1788813171.126208:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.126217:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.126225:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.127384:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813171.127454:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944171880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:2396:x1875706301738496:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 1339us (3268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813171.127463:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 92 00010000:00010000:0.0:1788813171.139573:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.139591:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813171.139616:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788813171.140271:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff70379a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729991 expref: 30 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.140298:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729991 expref: 29 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.140308:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:0.0:1788813171.140325:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788813171.140329:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dace00, rc 0) 00000100:00100000:0.0:1788813171.140464:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:11886:x1875706301738368:12345-192.168.202.13@tcp:101:bash.0 Request processed in 28652us (37856us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1788813171.140473:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 205 00000100:00100000:0.0:1788813171.160785:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813171.160862:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301738624 00000100:00100000:3.0:1788813171.160879:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301738624 00000100:00100000:3.0:1788813171.160954:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 206 00000100:00100000:3.0:1788813171.160964:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:11886:x1875706301738624:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:3.0:1788813171.160987:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813171.161008:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7037af lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729998 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.161040:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff7037b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.161054:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff7037b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.161065:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff7037b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.161170:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656600/0xf32533d6ff7037af lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729998 expref: 31 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.161187:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff7037b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729998 expref: 30 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.161208:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:3.0:1788813171.161211:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788813171.161215:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656e00, rc 0) 00000100:00100000:3.0:1788813171.161419:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:11886:x1875706301738624:12345-192.168.202.13@tcp:101:bash.0 Request processed in 455us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813171.161426:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 206 00000100:00100000:2.0:1788813171.185026:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813171.185161:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301738880 00000100:00100000:0.0:1788813171.185171:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301738880 00000100:00100000:0.0:1788813171.185228:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 207 00000100:00100000:0.0:1788813171.185238:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:11886:x1875706301738880:12345-192.168.202.13@tcp:36:bash.0 00010000:00010000:0.0:1788813171.185484:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff7037bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.185501:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff7037bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.185513:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff7037bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813171.185551:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1788813171.185581:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b187cfd1 reply state 00000000f9064914 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff7037bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.185592:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff7037bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.185598:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:0.0:1788813171.185601:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788813171.185604:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788813171.185677:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1788813171.185793:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+34:11886:x1875706301738880:12345-192.168.202.13@tcp:36:bash.0 Request processed in 555us (776us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788813171.185808:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 207 00000020:00080000:0.0:1788813171.185813:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788813171.201618:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813171.201720:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301739008 00000100:00100000:0.0:1788813171.201730:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301739008 00000100:00100000:0.0:1788813171.201790:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 208 00000100:00100000:0.0:1788813171.201801:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+34:11886:x1875706301739008:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813171.201825:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813171.201856:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7037c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a072999f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.201928:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7037c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072999f expref: 35 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.201978:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7037c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072999f expref: 35 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.202001:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:0.0:1788813171.202004:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813171.202008:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdaa00, rc 0) 00000100:00100000:0.0:1788813171.202060:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+35:11886:x1875706301739008:12345-192.168.202.13@tcp:101:bash.0 Request processed in 260us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813171.202067:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 208 00000100:00100000:1.0:1788813171.219860:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813171.219979:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301739136 00000100:00100000:3.0:1788813171.219989:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301739136 00000100:00100000:3.0:1788813171.220048:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 66 00000100:00100000:3.0:1788813171.220059:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489441fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:11886:x1875706301739136:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:3.0:1788813171.220078:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813171.220099:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f84a575/0xf32533d6ff7037cb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07299a6 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813171.220133:0:8404:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f1f70, atime: 0x6a9f1f6e, ctime: 0x6a9f1f70, blocks: 0x8 00010000:00010000:3.0:1788813171.220156:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=324s v=(0 0) 00010000:00010000:3.0:1788813171.220161:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813171.220170:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f84a575/0xf32533d6ff7037cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299a6 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.220188:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f84a575/0xf32533d6ff7037cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299a6 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.220213:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656600, rc 0) 00000100:00100000:3.0:1788813171.220271:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489441fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:11886:x1875706301739136:12345-192.168.202.13@tcp:101:bash.0 Request processed in 214us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813171.220291:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 66 00000100:00100000:1.0:1788813171.225078:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813171.225171:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301739264 00000100:00100000:0.0:1788813171.225182:0:8410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301739264 00002000:00010000:0.0:1788813171.225227:0:8410:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788813171.225233:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948944050700 with x1875706301739264 ext(0->18446744073709551615) 00002000:00010000:0.0:1788813171.225256:0:8410:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948944050700. 00000100:00100000:0.0:1788813171.225302:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:0.0:1788813171.225312:0:8410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2396:x1875706301739264:12345-192.168.202.13@tcp:10:bash.0 00002000:00010000:0.0:1788813171.225675:0:8410:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788813171.225679:0:8410:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788813168 -> 1788813171 00002000:00010000:0.0:1788813171.225682:0:8410:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788813166 -> 1788813166 00002000:00010000:0.0:1788813171.225684:0:8410:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788813168 -> 1788813171 00002000:00010000:0.0:1788813171.225686:0:8410:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788813171.225908:0:8410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2396:x1875706301739264:12345-192.168.202.13@tcp:10:bash.0 Request processed in 595us (840us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788813171.225917:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 5 00002000:00010000:0.0:1788813171.225922:0:8410:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788813171.225925:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948944050700 with x1875706301739264 ext(0->18446744073709551615) 00002000:00010000:0.0:1788813171.225965:0:8410:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948944050700. 00000100:00100000:2.0:1788813171.363670:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813171.363805:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301739392 00000100:00100000:3.0:1788813171.363815:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301739392 00000100:00100000:3.0:1788813171.363897:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 209 00000100:00100000:3.0:1788813171.363907:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+35:12377:x1875706301739392:12345-192.168.202.13@tcp:34:lfs.0 00010000:00010000:3.0:1788813171.364020:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037d2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364036:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364048:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364064:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364072:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364078:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364145:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7037e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364153:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7037e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364160:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7037e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813171.364218:0:12571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7037e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364228:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364234:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037d2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364240:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364246:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813171.364250:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364257:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037d2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364268:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:3.0:1788813171.364271:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813171.364276:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364281:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364293:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364298:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364310:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364316:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813171.364318:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364325:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364333:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a7b709500) 00010000:00010000:3.0:1788813171.364335:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813171.364338:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364509:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364525:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7037e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364530:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7037e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364536:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7037e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364541:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813171.364544:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7037e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364568:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7037e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364578:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:3.0:1788813171.364581:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813171.364584:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7037e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.364589:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7037e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813171.364662:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+35:12377:x1875706301739392:12345-192.168.202.13@tcp:34:lfs.0 Request processed in 756us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813171.364670:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 209 00000100:00100000:1.0:1788813171.440108:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813171.440193:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301739648 00000100:00100000:3.0:1788813171.440203:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301739648 00000100:00100000:3.0:1788813171.440261:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 210 00000100:00100000:3.0:1788813171.440270:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+35:12380:x1875706301739648:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813171.440290:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813171.440310:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7037e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07299ad expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440389:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440403:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440414:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440440:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440447:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440453:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440556:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7037fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440578:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7037fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440585:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7037fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813171.440595:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788813171.440665:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440672:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440678:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440684:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813171.440688:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440705:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440716:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:3.0:1788813171.440720:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813171.440725:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440731:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff7037ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440745:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440751:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440756:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440761:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813171.440763:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440769:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440776:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a7b709500) 00010000:00010000:3.0:1788813171.440779:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813171.440781:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440796:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7037f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440847:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7037e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299ad expref: 38 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440871:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7037fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299ad expref: 37 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.440878:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:3.0:1788813171.440881:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788813171.440884:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656200, rc 0) 00000100:00100000:3.0:1788813171.440997:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+37:12380:x1875706301739648:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 727us (899us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788813171.441005:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 210 00000100:00100000:1.0:1788813171.451793:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813171.451980:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301739776 00000100:00100000:2.0:1788813171.451993:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301739776 00000100:00100000:2.0:1788813171.452057:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 211 00000100:00100000:2.0:1788813171.452068:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+37:12380:x1875706301739776:12345-192.168.202.13@tcp:54:lfs.0 00010000:00010000:2.0:1788813171.452146:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70380a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.452163:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729991 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.452184:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70380a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.452217:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729991 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.452231:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729991 expref: 37 pid: 6495 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813171.452247:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1875706313317888:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813171.452547:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943382d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813171.458842:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1875706313317888:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813171.458884:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70380a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813171.459066:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813171.459980:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301740032 00000100:00100000:1.0:1788813171.459991:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301740032 00000100:00100000:1.0:1788813171.460047:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 52 00000100:00100000:1.0:1788813171.460057:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:6156:x1875706301740032:12345-192.168.202.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788813171.460467:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+39:6156:x1875706301740032:12345-192.168.202.13@tcp:35:ldlm_bl.0 Request processed in 410us (1400us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788813171.460475:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 52 00000100:00100000:1.0:1788813171.472402:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813171.472598:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301740160 00000100:00100000:2.0:1788813171.472608:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301740160 00010000:00010000:2.0:1788813171.472654:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729991 expref: 39 pid: 6495 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813171.472685:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 93 00000100:00100000:2.0:1788813171.472695:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+39:2397:x1875706301740160:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813171.472711:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813171.472719:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729991 expref: 39 pid: 6495 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.472733:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729991 expref: 39 pid: 6495 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.472774:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7037a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729991 expref: 39 pid: 6495 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.472791:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:2.0:1788813171.472796:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70380a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.472805:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70380a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.472813:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70380a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.472858:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813171.472923:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:2397:x1875706301740160:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 229us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813171.472960:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 93 00010000:00010000:1.0:1788813171.474056:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70380a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.474069:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70380a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.474107:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70380a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.474126:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70380a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.474132:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70380a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.474137:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813171.474141:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70380a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.474148:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70380a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.474160:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:1.0:1788813171.474163:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813171.474167:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70380a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.474188:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70380a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813171.474255:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+37:12380:x1875706301739776:12345-192.168.202.13@tcp:54:lfs.0 Request processed in 22187us (22473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813171.474263:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 211 00000100:00100000:1.0:1788813171.477609:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813171.477684:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301740416 00000100:00100000:3.0:1788813171.477693:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301740416 00000100:00100000:3.0:1788813171.477749:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 53 00000100:00100000:3.0:1788813171.477758:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+37:12380:x1875706301740416:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:3.0:1788813171.478273:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:12380:x1875706301740416:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 515us (672us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788813171.478281:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 53 00000100:00100000:2.0:1788813171.638342:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813171.639755:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301740672 00000100:00100000:3.0:1788813171.639768:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301740672 00000100:00100000:3.0:1788813171.639840:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 212 00000100:00100000:3.0:1788813171.639850:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+38:12391:x1875706301740672:12345-192.168.202.13@tcp:101:cat.0 00010000:00010000:3.0:1788813171.639898:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813171.639919:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703811 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07299b4 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640038:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703818 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640053:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703818 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640065:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703818 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640078:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70381f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640085:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70381f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640092:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70381f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640188:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff703826 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640196:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff703826 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640203:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff703826 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813171.640211:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788813171.640601:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703818 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640609:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703818 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640616:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703818 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640622:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813171.640626:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703818 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640633:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703818 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640645:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:3.0:1788813171.640648:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813171.640653:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703818 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640669:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703818 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640682:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70381f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640688:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70381f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640695:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70381f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640711:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813171.640714:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70381f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640721:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70381f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640729:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a7b709500) 00010000:00010000:3.0:1788813171.640731:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813171.640734:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70381f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640740:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70381f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640778:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703811 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299b4 expref: 41 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640791:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff703826 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299b4 expref: 40 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.640798:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:3.0:1788813171.640801:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813171.640803:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657200, rc 0) 00000100:00100000:3.0:1788813171.640879:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+40:12391:x1875706301740672:12345-192.168.202.13@tcp:101:cat.0 Request processed in 1030us (2546us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788813171.640887:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 212 00000100:00100000:2.0:1788813171.653161:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813171.653256:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301740928 00000100:00100000:3.0:1788813171.653279:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301740928 00000100:00100000:3.0:1788813171.653341:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 54 00000100:00100000:3.0:1788813171.653353:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+40:12391:x1875706301740928:12345-192.168.202.13@tcp:35:cat.0 00000100:00100000:3.0:1788813171.653677:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+41:12391:x1875706301740928:12345-192.168.202.13@tcp:35:cat.0 Request processed in 325us (526us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788813171.653685:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 54 00010000:00010000:0.0:1788813171.684169:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813171.710681:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813171.713961:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301741184 00000100:00100000:0.0:1788813171.713976:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301741184 00000100:00100000:0.0:1788813171.714121:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 213 00000100:00100000:0.0:1788813171.714132:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+41:12392:x1875706301741184:12345-192.168.202.13@tcp:36:rm.0 00010000:00010000:0.0:1788813171.714185:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788813171.714209:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7037c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072999f expref: 41 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.714250:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657200/0xf32533d6ff703826 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299b4 expref: 40 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.714262:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff7037fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299ad expref: 39 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.714275:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff7037b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729998 expref: 38 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.714285:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:0.0:1788813171.714290:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813171.714310:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703834 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.714325:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703834 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.714334:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703834 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.714365:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70383b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.714372:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70383b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.714379:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70383b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.714461:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703842 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.714470:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703842 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.714478:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703842 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813171.715454:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1788813171.715464:0:6495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 324734531990ns, next at 325734529143ns, rc = 0 00010000:00010000:0.0:1788813171.715686:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703849 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.715699:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703849 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.715707:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703849 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.715715:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703849 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.715721:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703849 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.715727:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703849 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.715752:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813171.715781:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703842 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.715797:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703842 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.715802:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703842 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.715809:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166f400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813171.715813:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703842 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.715820:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813171.715826:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703849 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.715832:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166fc00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813171.715835:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703849 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.715841:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703849 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.715872:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:2.0:1788813171.715876:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788813171.715880:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703849 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.715886:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703849 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.715900:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813171.715902:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813171.715903:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813171.715951:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703842 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.715961:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:0.0:1788813171.715964:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788813171.715967:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703842 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.715973:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703842 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.715989:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703834 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.715995:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703834 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.716001:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703834 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.716006:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813171.716015:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703834 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.716022:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703834 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.716030:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:0.0:1788813171.716033:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813171.716036:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703834 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.716052:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff703834 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813171.716063:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c83e5cda reply state 00000000ee741b2a transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70383b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.716071:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70383b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.716078:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15200) 00010000:00010000:0.0:1788813171.716080:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788813171.716083:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813171.716172:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+39:12392:x1875706301741184:12345-192.168.202.13@tcp:36:rm.0 Request processed in 2038us (5497us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788813171.716180:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 213 00000100:00100000:2.0:1788813171.787694:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813171.787787:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301741440 00000100:00100000:1.0:1788813171.787797:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301741440 00000100:00100000:1.0:1788813171.787870:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 214 00000100:00100000:1.0:1788813171.787882:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+39:12398:x1875706301741440:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:1.0:1788813171.787906:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813171.787925:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff703850 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07299bb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.788060:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff703857 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.788075:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff703857 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.788086:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff703857 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.788095:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff70385e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.788102:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff70385e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.788122:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff70385e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788813171.788428:0:6496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788813171.789364:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703865 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.789378:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703865 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.789388:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703865 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.789421:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff703857 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.789429:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff703857 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.789436:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff703857 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.789442:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813171.789446:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff703857 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.789453:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff703857 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.789464:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:1.0:1788813171.789467:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813171.789483:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff703857 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.789489:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff703857 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813171.789505:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b752340 reply state 00000000edc5cae4 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff70385e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.789607:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff70385e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.789614:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15200) 00010000:00010000:1.0:1788813171.789617:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788813171.789620:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788813171.789655:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff703850 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299bb expref: 42 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.789733:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703865 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299bb expref: 41 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813171.789740:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a63b32c00) 00010000:00010000:1.0:1788813171.789742:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813171.789745:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dada00, rc 0) 00000100:00100000:1.0:1788813171.790072:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+42:12398:x1875706301741440:12345-192.168.202.13@tcp:101:bash.0 Request processed in 2192us (2389us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788813171.790080:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 214 00000100:00100000:2.0:1788813171.799972:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813171.800102:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301741568 00000100:00100000:0.0:1788813171.800112:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301741568 00000100:00100000:0.0:1788813171.800169:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:0.0:1788813171.800179:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2398:x1875706301741568:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813171.800199:0:10066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813171.800233:0:10066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093573cca/0xf32533d6ff703873 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07299c2 expref: -99 pid: 10066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813171.800258:0:10066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813171.800278:0:10066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=324s v=(0 0) 00010000:00010000:0.0:1788813171.800282:0:10066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813171.800291:0:10066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093573cca/0xf32533d6ff703873 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c2 expref: 8 pid: 10066 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.800309:0:10066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000093573cca/0xf32533d6ff703873 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c2 expref: 8 pid: 10066 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.800321:0:10066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f200, rc 0) 00000100:00100000:0.0:1788813171.800380:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2398:x1875706301741568:12345-192.168.202.13@tcp:101:bash.0 Request processed in 202us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813171.800387:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:0.0:1788813171.810757:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813171.812926:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301741696 00000100:00100000:3.0:1788813171.812955:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301741696 00000100:00100000:2.0:1788813171.816229:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 68 00000100:00100000:2.0:1788813171.816245:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:12398:x1875706301741696:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:2.0:1788813171.816263:0:14190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813171.816282:0:14190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07299c9 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.816316:0:14190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000093573cca/0xf32533d6ff703873 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c2 expref: 9 pid: 10066 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.816326:0:14190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813171.816330:0:14190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813171.816335:0:14190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 9 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.816389:0:14190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000093573cca/0xf32533d6ff703873 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c2 expref: 9 pid: 10066 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813171.816403:0:14190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000093573cca/0xf32533d6ff703873 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c2 expref: 9 pid: 10066 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813171.816419:0:14190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14190:1875706313318016:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813171.816586:0:14190:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489433829c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813171.835167:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813171.836970:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301741824 00000100:00100000:3.0:1788813171.836985:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301741824 00010000:00010000:3.0:1788813171.837033:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000093573cca/0xf32533d6ff703873 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c2 expref: 10 pid: 10066 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813171.837073:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 94 00000100:00100000:3.0:1788813171.837083:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+10:2396:x1875706301741824:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813171.837100:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813171.837121:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000093573cca/0xf32533d6ff703873 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c2 expref: 10 pid: 10066 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.837134:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000093573cca/0xf32533d6ff703873 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c2 expref: 10 pid: 10066 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.837158:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813171.837162:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813171.837171:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 10 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.837198:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 10 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813171.837236:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 10 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813171.837251:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6480:1875706313318144:192.168.202.13@tcp:105: 00000100:00100000:3.0:1788813171.837347:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788813171.846217:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6480:1875706313318144:192.168.202.13@tcp:105: 00010000:00010000:3.0:1788813171.846246:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813171.846306:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+10:2396:x1875706301741824:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 9223us (11148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813171.846326:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 94 00010000:00010000:0.0:1788813171.848609:0:14190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093573cca/0xf32533d6ff703873 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c2 expref: 9 pid: 10066 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813171.848634:0:14190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14190:1875706313318016:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813171.848664:0:14190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 8 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813171.848678:0:14190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09200, rc 0) 00000100:00100000:0.0:1788813171.848739:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:12398:x1875706301741696:12345-192.168.202.13@tcp:101:bash.0 Request processed in 32497us (37990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813171.848763:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 68 00000100:00100000:2.0:1788813171.852565:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813171.852646:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301742080 00000100:00100000:3.0:1788813171.852657:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301742080 00000100:00100000:3.0:1788813171.852719:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 55 00000100:00100000:3.0:1788813171.852730:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+42:12398:x1875706301742080:12345-192.168.202.13@tcp:35:bash.0 00000100:00100000:3.0:1788813171.853059:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+43:12398:x1875706301742080:12345-192.168.202.13@tcp:35:bash.0 Request processed in 330us (511us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788813171.853066:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 55 00000001:00080000:1.0:1788813172.078606:0:8399:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1788813172.078629:0:8399:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:2.0:1788813172.182231:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813172.187501:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301742208 00000100:00100000:3.0:1788813172.187523:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301742208 00000100:00100000:3.0:1788813172.187637:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 215 00000100:00100000:3.0:1788813172.187655:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+43:12414:x1875706301742208:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813172.187702:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813172.187732:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703881 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07299d0 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.187836:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703888 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.187866:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.187887:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813172.187980:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788813172.187984:0:12571:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813172.188009:0:12571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.188040:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703881 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299d0 expref: 45 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.188063:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703888 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299d0 expref: 44 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.188071:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:3.0:1788813172.188075:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813172.188079:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657600, rc 0) 00000100:00080000:0.0:1788813172.190212:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813172.190456:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+44:12414:x1875706301742208:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 2801us (8233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813172.190469:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 215 00000100:00100000:2.0:1788813172.196312:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813172.196435:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301742464 00000100:00100000:0.0:1788813172.196449:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301742464 00000100:00100000:0.0:1788813172.196535:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 216 00000100:00100000:0.0:1788813172.196547:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+44:12414:x1875706301742464:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813172.196576:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813172.196607:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff70388f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07299d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.196760:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703896 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.196779:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703896 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.196795:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703896 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813172.196809:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788813172.197428:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff70388f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299d7 expref: 47 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.197454:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703896 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299d7 expref: 46 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.197465:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a63b32c00) 00010000:00010000:0.0:1788813172.197468:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813172.197494:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f200, rc 0) 00000100:00100000:0.0:1788813172.197580:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+46:12414:x1875706301742464:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 1035us (1497us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788813172.197589:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 216 00000100:00100000:2.0:1788813172.203349:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813172.203456:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813172.203666:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301742848 00000100:00100000:0.0:1788813172.203681:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301742848 00000100:00100000:0.0:1788813172.203772:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:0.0:1788813172.203795:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50680850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+46:2396:x1875706301742848:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813172.203816:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813172.203849:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703896 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299d7 expref: 46 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.203902:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a63b32c00) 00010000:00010000:0.0:1788813172.203909:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813172.204030:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50680850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+45:2396:x1875706301742848:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 239us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813172.204039:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:1.0:1788813172.208736:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301742720 00000100:00100000:1.0:1788813172.208782:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301742720 00000100:00100000:1.0:1788813172.209501:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 217 00000100:00100000:1.0:1788813172.209517:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+45:12414:x1875706301742720:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813172.209552:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813172.209584:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7038a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07299de expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.209733:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7038ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.209753:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7038ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.209769:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7038ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813172.209785:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788813172.209978:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad600/0xf32533d6ff7038a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299de expref: 48 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.210003:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7038ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299de expref: 47 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.210013:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a63b32c00) 00010000:00010000:1.0:1788813172.210016:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788813172.210021:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dad000, rc 0) 00000100:00100000:1.0:1788813172.210166:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+47:12414:x1875706301742720:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 654us (6835us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1788813172.210174:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 217 00000100:00100000:2.0:1788813172.218604:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813172.218703:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301742976 00000100:00100000:3.0:1788813172.218716:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301742976 00000100:00100000:3.0:1788813172.218812:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 69 00000100:00100000:3.0:1788813172.218834:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+6:2399:x1875706301742976:12345-192.168.202.13@tcp:1:lfs.0 00000100:00080000:0.0:1788813172.220147:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788813172.220305:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b659bee8/0xf32533d6ff7038b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.220334:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 6 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.220345:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788813172.220351:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813172.220356:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b659bee8/0xf32533d6ff7038b9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.220412:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 6 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.220432:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 6 pid: 14190 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813172.220450:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8404:1875706313318272:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813172.220815:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813172.225658:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8404:1875706313318272:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813172.225701:0:8404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b659bee8/0xf32533d6ff7038b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813172.229592:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813172.230177:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301743104 00000100:00100000:3.0:1788813172.230192:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301743104 00002000:00100000:3.0:1788813172.230271:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9489443b0380 x1875706301743104/t0(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:743/0 lens 504/0 e 0 to 0 dl 1788813183 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788813172.230286:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9489443b0380 with x1875706301743104 ext(0->8) 00010000:00010000:3.0:1788813172.230297:0:8411:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 7 pid: 14190 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.230316:0:8411:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 7 pid: 14190 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813172.230324:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9489443b0380 00000100:00100000:3.0:1788813172.230369:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:3.0:1788813172.230380:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2397:x1875706301743104:12345-192.168.202.13@tcp:4:lfs.0 00000100:00100000:2.0:1788813172.236071:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2397:x1875706301743104:12345-192.168.202.13@tcp:4:lfs.0 Request processed in 5677us (6484us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788813172.236087:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3 00002000:00100000:2.0:1788813172.236158:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9489443b0380 x1875706301743104/t4294967309(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:743/0 lens 504/448 e 0 to 0 dl 1788813183 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788813172.236171:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9489443b0380 with x1875706301743104 ext(0->8) 00010000:00010000:2.0:1788813172.236187:0:8411:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 9 pid: 14190 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813172.236236:0:8411:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 9 pid: 14190 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813172.236246:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9489443b0380 00000100:00100000:2.0:1788813172.246375:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813172.248491:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301743232 00000100:00100000:0.0:1788813172.248513:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301743232 00010000:00010000:0.0:1788813172.248652:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 9 pid: 14190 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813172.248707:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 95 00000100:00100000:0.0:1788813172.248718:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2398:x1875706301743232:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813172.248736:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788813172.248759:0:6524:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788813172.248779:0:6524:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788813172 00002000:00010000:0.0:1788813172.248782:0:6524:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788813172 00002000:00010000:0.0:1788813172.248784:0:6524:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788813172 00002000:00010000:0.0:1788813172.248787:0:6524:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788813172.248795:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 9 pid: 14190 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.248813:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 9 pid: 14190 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.249522:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff70387a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299c9 expref: 9 pid: 14190 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.249547:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813172.249743:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813172.249753:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b659bee8/0xf32533d6ff7038b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.249767:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b659bee8/0xf32533d6ff7038b9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.249874:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813172.250023:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2398:x1875706301743232:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 1304us (3660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813172.250032:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 95 00010000:00010000:3.0:1788813172.253404:0:8404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b659bee8/0xf32533d6ff7038b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.253431:0:8404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b659bee8/0xf32533d6ff7038b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.253474:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b659bee8/0xf32533d6ff7038b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.253484:0:8404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b659bee8/0xf32533d6ff7038b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.253516:0:8404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b659bee8/0xf32533d6ff7038b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.253524:0:8404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813172.253529:0:8404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b659bee8/0xf32533d6ff7038b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.253540:0:8404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b659bee8/0xf32533d6ff7038b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.253636:0:8404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b659bee8/0xf32533d6ff7038b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.253646:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b659bee8/0xf32533d6ff7038b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813172.253844:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2399:x1875706301742976:12345-192.168.202.13@tcp:1:lfs.0 Request processed in 35006us (35248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813172.253866:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 69 00000100:00100000:2.0:1788813172.266174:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813172.266565:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301743488 00000100:00100000:3.0:1788813172.266581:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301743488 00000100:00100000:3.0:1788813172.266658:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 56 00000100:00100000:3.0:1788813172.266671:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a612cf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+47:12414:x1875706301743488:12345-192.168.202.13@tcp:35:lfs.0 00000004:00010000:3.0:1788813172.266759:0:6498:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7038ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299de expref: 47 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813172.267066:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1788813172.267110:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788813172.267792:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1788813172.267842:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7038c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.267871:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703865 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299bb expref: 51 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.267882:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7038c0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.269093:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703865 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299bb expref: 51 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.269127:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703865 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299bb expref: 51 pid: 6496 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813172.269147:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1875706313318400:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813172.269362:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813172.277036:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1875706313318400:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813172.277076:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7038c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813172.279050:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813172.280412:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301743616 00000100:00100000:3.0:1788813172.280428:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301743616 00010000:00010000:2.0:1788813172.280639:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703865 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299bb expref: 52 pid: 6496 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813172.280694:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 96 00000100:00100000:2.0:1788813172.280706:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+52:2396:x1875706301743616:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813172.280724:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813172.280732:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703865 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299bb expref: 52 pid: 6496 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813172.280748:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703865 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299bb expref: 52 pid: 6496 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813172.280775:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dada00/0xf32533d6ff703865 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299bb expref: 52 pid: 6496 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813172.280798:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a63b32c00) 00010000:00010000:2.0:1788813172.280805:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7038c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813172.280852:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7038c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813172.280872:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7038c0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813172.280908:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813172.281345:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7038c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.281368:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7038c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813172.282217:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+51:2396:x1875706301743616:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 1507us (3173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813172.282230:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 96 00000001:00080000:3.0:1788813172.282627:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1788813172.282766:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1788813172.282908:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313318528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788813172.284666:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813172.284714:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813172.285435:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313318528 00000100:00100000:2.0:1788813172.285448:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313318528 00000100:00100000:2.0:1788813172.285519:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788813172.285532:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6498:x1875706313318528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788813172.285677:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6498:x1875706313318528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 147us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813172.285685:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788813172.287284:0:6498:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1788813172.287296:0:6498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:3.0:1788813172.287334:0:6498:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff948944239f80, transno 4294967308 00000100:00100000:3.0:1788813172.287349:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313318528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788813172.287672:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1788813172.287776:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313318656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788813172.287842:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813172.287890:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813172.288675:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313318656 00000100:00100000:2.0:1788813172.288686:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313318656 00000100:00100000:2.0:1788813172.288755:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788813172.288767:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6498:x1875706313318656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788813172.289223:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6498:x1875706313318656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 456us (1378us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788813172.289231:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788813172.290367:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1875706313318656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788813172.290532:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1788813172.290596:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7038c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.290610:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7038c0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.290619:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7038c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.290626:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813172.290632:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7038c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.290641:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7038c0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.290660:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a63b32c00) 00010000:00010000:1.0:1788813172.290664:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788813172.290671:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7038c0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.290678:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff7038c0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788813172.290832:0:6498:0:(mdd_object.c:4199:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788813172.292199:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788813172.292225:0:6498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325311292590ns, next at 326311286170ns, rc = 0 00000001:00080000:1.0:1788813172.292912:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1788813172.293458:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a63b32c00) 00010000:00010000:1.0:1788813172.293485:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788813172.293499:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7038ab lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299de expref: 55 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813172.293678:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a612cf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+54:12414:x1875706301743488:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 27008us (27533us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788813172.293690:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 56 00000020:00080000:1.0:1788813172.293698:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788813172.299736:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813172.300286:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301743744 00000100:00100000:1.0:1788813172.300300:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301743744 00000100:00100000:1.0:1788813172.300520:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 218 00000100:00100000:1.0:1788813172.300533:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+54:12414:x1875706301743744:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813172.300565:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813172.300594:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7038c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07299e5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.300926:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7038c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299e5 expref: 55 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.301302:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7038c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299e5 expref: 55 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.301477:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:1.0:1788813172.301482:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813172.301488:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dad000, rc 0) 00000100:00100000:1.0:1788813172.301563:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+55:12414:x1875706301743744:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 1033us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813172.301571:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 218 00000100:00100000:3.0:1788813172.308518:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813172.308724:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301744000 00000100:00100000:1.0:1788813172.308813:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301744000 00000100:00100000:1.0:1788813172.309032:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 57 00000100:00100000:1.0:1788813172.309045:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+55:12414:x1875706301744000:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813172.309366:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+56:12414:x1875706301744000:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 324us (858us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788813172.309374:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 57 00000100:00100000:2.0:1788813172.613072:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813172.613346:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301744128 00000100:00100000:3.0:1788813172.613359:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301744128 00000100:00100000:3.0:1788813172.613436:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 219 00000100:00100000:3.0:1788813172.613446:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+56:12424:x1875706301744128:12345-192.168.202.13@tcp:34:lfs.0 00010000:00010000:3.0:1788813172.613546:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7038ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613565:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7038ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613599:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7038ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613610:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff7038d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613615:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff7038d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613620:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff7038d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613710:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff7038dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613715:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff7038dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613720:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff7038dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813172.613780:0:9156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff7038dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613795:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7038ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613802:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7038ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613808:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7038ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613821:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813172.613825:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7038ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613833:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7038ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613844:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:3.0:1788813172.613846:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813172.613861:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7038ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613866:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff7038ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613879:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff7038d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613883:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff7038d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613887:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff7038d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613890:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813172.613892:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff7038d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613895:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff7038d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613907:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15200) 00010000:00010000:3.0:1788813172.613908:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813172.613911:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff7038d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613915:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff7038d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613921:0:9156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff7038dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613924:0:9156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff7038dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.613927:0:9156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff7038dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.614266:0:9156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813172.614269:0:9156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff7038dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.614274:0:9156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff7038dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.614280:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:3.0:1788813172.614282:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813172.614284:0:9156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff7038dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.614288:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff7038dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813172.614390:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+56:12424:x1875706301744128:12345-192.168.202.13@tcp:34:lfs.0 Request processed in 944us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813172.614397:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 219 00010000:00010000:1.0:1788813172.715796:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813172.745627:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813172.745828:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301744384 00000100:00100000:1.0:1788813172.745840:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301744384 00000100:00100000:1.0:1788813172.745914:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 220 00000100:00100000:1.0:1788813172.745923:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+56:12427:x1875706301744384:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813172.745981:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813172.746008:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff7038e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07299ec expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.746802:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7038ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.746824:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7038ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.746838:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7038ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.746883:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7038f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.746892:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7038f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.746925:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7038f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.747764:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff7038f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.747775:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff7038f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.747782:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff7038f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813172.747791:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788813172.747903:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7038ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.747912:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7038ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.747919:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7038ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.747925:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dace00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813172.748009:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7038ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.748021:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7038ea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.748037:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:1.0:1788813172.748041:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813172.748127:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7038ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.748134:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7038ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.748150:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7038f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.748158:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7038f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.748225:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7038f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.748231:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813172.748234:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7038f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.748241:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7038f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.748249:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15200) 00010000:00010000:1.0:1788813172.748252:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813172.748255:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7038f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.748262:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac400/0xf32533d6ff7038f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.748310:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad200/0xf32533d6ff7038e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299ec expref: 59 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.748340:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff7038f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299ec expref: 58 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.748347:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:1.0:1788813172.748349:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813172.748352:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dade00, rc 0) 00000100:00100000:1.0:1788813172.748451:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+58:12427:x1875706301744384:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 2528us (2834us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788813172.748461:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 220 00000100:00100000:1.0:1788813172.752304:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813172.752365:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301744512 00000100:00100000:3.0:1788813172.752377:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301744512 00000100:00100000:3.0:1788813172.752458:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 221 00000100:00100000:3.0:1788813172.752468:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+58:12427:x1875706301744512:12345-192.168.202.13@tcp:54:lfs.0 00010000:00010000:3.0:1788813172.752550:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703906 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.752568:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.752579:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.752617:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.752622:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703906 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.752628:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703906 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.752632:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813172.752635:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703906 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.752641:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703906 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.752674:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:3.0:1788813172.752678:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813172.752684:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703906 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.752690:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703906 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813172.752908:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+58:12427:x1875706301744512:12345-192.168.202.13@tcp:54:lfs.0 Request processed in 442us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813172.752916:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 221 00000100:00100000:2.0:1788813172.755377:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813172.755428:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301744768 00000100:00100000:3.0:1788813172.755442:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301744768 00000100:00100000:3.0:1788813172.755506:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 58 00000100:00100000:3.0:1788813172.755514:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+58:12427:x1875706301744768:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:3.0:1788813172.755800:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+59:12427:x1875706301744768:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 286us (434us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788813172.755806:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 58 00000100:00100000:2.0:1788813172.810296:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813172.810594:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301745024 00000100:00100000:3.0:1788813172.810607:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301745024 00000100:00100000:3.0:1788813172.810690:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 222 00000100:00100000:3.0:1788813172.810702:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+59:12437:x1875706301745024:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:3.0:1788813172.810735:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813172.810738:0:9156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788813172.810773:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff703888 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299d0 expref: 59 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.810820:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:3.0:1788813172.810827:0:9156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813172.810843:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff70390d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07299f3 expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.811154:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.811170:0:9156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff7038f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299ec expref: 59 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.811178:0:9156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.811220:0:9156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff7038f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299ec expref: 59 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.811235:0:9156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff7038f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299ec expref: 59 pid: 6496 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813172.811250:0:9156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9156:1875706313318784:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813172.812169:0:9156:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813172.816745:0:9156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9156:1875706313318784:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813172.816783:0:9156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813172.826529:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813172.826604:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301745152 00000100:00100000:0.0:1788813172.826618:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301745152 00010000:00010000:0.0:1788813172.826677:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff7038f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299ec expref: 60 pid: 6496 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813172.826878:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 97 00000100:00100000:0.0:1788813172.826901:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+60:2396:x1875706301745152:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813172.826924:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813172.827085:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff7038f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299ec expref: 60 pid: 6496 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.827102:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff7038f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299ec expref: 60 pid: 6496 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.827143:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dade00/0xf32533d6ff7038f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299ec expref: 60 pid: 6496 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.827168:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:0.0:1788813172.827175:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.827185:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.827194:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.827236:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813172.827310:0:9156:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813172.827314:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+59:2396:x1875706301745152:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 415us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813172.827327:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 97 00010000:00010000:3.0:1788813172.827329:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813172.827352:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788813172.827522:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff70390d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299f3 expref: 60 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.827544:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299f3 expref: 59 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.827567:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:3.0:1788813172.827570:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788813172.827573:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657400, rc 0) 00000100:00100000:3.0:1788813172.827614:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+59:12437:x1875706301745024:12345-192.168.202.13@tcp:101:bash.0 Request processed in 16914us (17333us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788813172.827623:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 222 00000100:00100000:2.0:1788813172.830091:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813172.830202:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301745280 00000100:00100000:1.0:1788813172.830215:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301745280 00000100:00100000:1.0:1788813172.830366:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 223 00000100:00100000:1.0:1788813172.830380:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+59:12437:x1875706301745280:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:1.0:1788813172.830411:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813172.830435:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703922 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a07299fa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.830480:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff703929 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.830496:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff703929 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.830510:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff703929 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.830687:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff703922 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299fa expref: 61 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.830710:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff703929 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299fa expref: 60 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813172.830719:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:1.0:1788813172.830723:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788813172.830727:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac200, rc 0) 00000100:00100000:1.0:1788813172.830796:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+60:12437:x1875706301745280:12345-192.168.202.13@tcp:101:bash.0 Request processed in 421us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813172.830802:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 223 00000100:00100000:1.0:1788813172.833392:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813172.833627:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301745536 00000100:00100000:0.0:1788813172.833652:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301745536 00000100:00100000:0.0:1788813172.833711:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 224 00000100:00100000:0.0:1788813172.833721:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+60:12437:x1875706301745536:12345-192.168.202.13@tcp:36:bash.0 00010000:00010000:0.0:1788813172.834074:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703930 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.834096:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703930 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.834109:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703930 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813172.834162:0:12571:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1788813172.834189:0:12571:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053b3d2de reply state 00000000bc1230c3 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703930 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.834200:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703930 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.834207:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:0.0:1788813172.834210:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788813172.834213:0:12571:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813172.834301:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+63:12437:x1875706301745536:12345-192.168.202.13@tcp:36:bash.0 Request processed in 581us (922us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788813172.834307:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 224 00000020:00080000:0.0:1788813172.834312:0:12571:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788813172.836912:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813172.837012:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301745664 00000100:00100000:3.0:1788813172.837025:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301745664 00000100:00100000:3.0:1788813172.837101:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 225 00000100:00100000:3.0:1788813172.837113:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+63:12437:x1875706301745664:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:3.0:1788813172.837141:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813172.837167:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703937 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a01 expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.837279:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.837315:0:9156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299f3 expref: 64 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.837327:0:9156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.837372:0:9156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299f3 expref: 64 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.837388:0:9156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299f3 expref: 64 pid: 9156 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813172.837404:0:9156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9156:1875706313318912:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813172.837516:0:9156:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813172.840794:0:9156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9156:1875706313318912:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813172.840839:0:9156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813172.841429:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813172.842027:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301745792 00000100:00100000:0.0:1788813172.842039:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301745792 00010000:00010000:0.0:1788813172.842095:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299f3 expref: 65 pid: 9156 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813172.842172:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 98 00000100:00100000:0.0:1788813172.842185:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+65:2396:x1875706301745792:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813172.842208:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813172.842215:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299f3 expref: 65 pid: 9156 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.842227:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299f3 expref: 65 pid: 9156 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.842250:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703914 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299f3 expref: 65 pid: 9156 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.842265:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:0.0:1788813172.842270:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.842279:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.842285:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.842315:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813172.842344:0:9156:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.842353:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813172.842374:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+64:2396:x1875706301745792:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 192us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813172.842380:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 98 00000004:00200000:3.0:1788813172.842424:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788813172.842431:0:9156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813172.842458:0:9156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.842511:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703937 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a01 expref: 64 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.842531:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a01 expref: 63 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.842540:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:3.0:1788813172.842543:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813172.842546:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657600, rc 0) 00000100:00100000:3.0:1788813172.842578:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+63:12437:x1875706301745664:12345-192.168.202.13@tcp:101:bash.0 Request processed in 5467us (5679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813172.842586:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 225 00000100:00100000:2.0:1788813172.847107:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813172.849349:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301746048 00000100:00100000:1.0:1788813172.849369:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301746048 00000100:00100000:1.0:1788813172.850447:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 59 00000100:00100000:1.0:1788813172.850475:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+63:12437:x1875706301746048:12345-192.168.202.13@tcp:35:bash.0 00000100:00100000:1.0:1788813172.850796:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+64:12437:x1875706301746048:12345-192.168.202.13@tcp:35:bash.0 Request processed in 336us (3704us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788813172.850806:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 59 00000100:00100000:1.0:1788813172.896792:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813172.896969:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301746176 00000100:00100000:0.0:1788813172.897003:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301746176 00000100:00100000:0.0:1788813172.897607:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 226 00000100:00100000:0.0:1788813172.897620:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+64:12443:x1875706301746176:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813172.897746:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813172.897777:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703945 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a08 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.897881:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff70394c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.897900:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff70394c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.897915:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff70394c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813172.898066:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788813172.898071:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813172.898095:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff70394c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.898126:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f400/0xf32533d6ff703945 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a08 expref: 66 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.898151:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff70394c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a08 expref: 65 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.898827:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:0.0:1788813172.898834:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813172.898840:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f600, rc 0) 00000100:00100000:0.0:1788813172.899083:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+65:12443:x1875706301746176:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 1462us (2303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813172.899093:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 226 00000100:00100000:2.0:1788813172.902031:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813172.902149:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301746304 00000100:00100000:0.0:1788813172.902163:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301746304 00000100:00100000:0.0:1788813172.902323:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 227 00000100:00100000:0.0:1788813172.902337:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+65:12443:x1875706301746304:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813172.902366:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813172.902396:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703953 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a0f expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902491:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff70395a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902511:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff70395a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902525:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff70395a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902538:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703961 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902546:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703961 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902553:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703961 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902657:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff703968 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902685:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff703968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902692:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff703968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813172.902749:0:12571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788813172.902755:0:12571:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813172.902779:0:12571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff703968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902794:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff703968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902804:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff70395a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902812:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff70395a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902820:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff70395a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902826:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813172.902831:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff70395a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902841:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff70395a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902877:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:0.0:1788813172.902888:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813172.902895:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff70395a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902902:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff70395a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902920:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703961 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902926:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703961 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902960:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703961 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902966:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdaa00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813172.902969:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703961 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902974:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703961 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902982:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15200) 00010000:00010000:0.0:1788813172.902985:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813172.902988:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703961 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.902993:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff703961 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.903026:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff703953 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a0f expref: 67 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.903054:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff703968 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a0f expref: 66 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.903062:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:0.0:1788813172.903066:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813172.903068:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a40030800, rc 0) 00000100:00100000:0.0:1788813172.903213:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+66:12443:x1875706301746304:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 879us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813172.903222:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 227 00000100:00100000:2.0:1788813172.907055:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813172.907126:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813172.907646:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301746560 00000100:00100000:3.0:1788813172.907660:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301746560 00000100:00100000:3.0:1788813172.907783:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 228 00000100:00100000:3.0:1788813172.907796:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+66:12443:x1875706301746560:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813172.907826:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813172.907866:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff70396f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a16 expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.908051:0:9156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.908072:0:9156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a01 expref: 67 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.908083:0:9156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff703968 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a0f expref: 67 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.908111:0:9156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.908157:0:9156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff703968 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a0f expref: 67 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.908184:0:9156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff703968 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a0f expref: 67 pid: 12571 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813172.908200:0:9156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9156:1875706313319040:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813172.908350:0:9156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a01 expref: 67 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.908362:0:9156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a01 expref: 67 pid: 9156 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813172.908372:0:9156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9156:1875706313319168:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813172.908400:0:9156:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813172.912187:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301746688 00000100:00100000:0.0:1788813172.912206:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301746688 00010000:00010000:0.0:1788813172.912265:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff703968 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a0f expref: 68 pid: 12571 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813172.912311:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 99 00000100:00100000:0.0:1788813172.912322:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+68:2399:x1875706301746688:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813172.912342:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813172.912351:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff703968 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a0f expref: 68 pid: 12571 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.912379:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff703968 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a0f expref: 68 pid: 12571 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.912409:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:0.0:1788813172.912414:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.912458:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.912466:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813172.912541:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+68:2399:x1875706301746688:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 220us (5415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813172.912550:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 99 00000100:00100000:3.0:1788813172.920626:0:9156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9156:1875706313319168:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813172.922147:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00010000:00010000:3.0:1788813172.922493:0:9156:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.13@tcp) returned -22 from blocking AST (req@00000000881b0151 x1875706313319040) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff703968 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a0f expref: 67 pid: 12571 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.922520:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff703968 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a0f expref: 67 pid: 12571 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813172.922575:0:9156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9156:1875706313319040:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813172.922605:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:3.0:1788813172.922610:0:9156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.922620:0:9156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.922628:0:9156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813172.924696:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301746816 00000100:00100000:0.0:1788813172.924716:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301746816 00010000:00010000:0.0:1788813172.924778:0:9502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a01 expref: 67 pid: 9156 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813172.924898:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 100 00000100:00100000:0.0:1788813172.924910:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+67:2396:x1875706301746816:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813172.924986:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813172.924995:0:9502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a01 expref: 67 pid: 9156 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.925010:0:9502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a01 expref: 67 pid: 9156 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.925039:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657600/0xf32533d6ff70393e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a01 expref: 67 pid: 9156 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.925059:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:0.0:1788813172.925065:0:9502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.925083:0:9502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.925092:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.925123:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813172.925267:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+66:2396:x1875706301746816:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 357us (3127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813172.925274:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 100 00010000:00010000:3.0:1788813172.925331:0:9156:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.925340:0:9156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813172.925365:0:9156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788813172.925539:0:9156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff70396f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a16 expref: 67 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.926078:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a16 expref: 66 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.926087:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:3.0:1788813172.926090:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788813172.926093:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656a00, rc 0) 00000100:00100000:3.0:1788813172.926342:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+66:12443:x1875706301746560:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 18548us (19301us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788813172.926361:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 228 00000100:00100000:2.0:1788813172.937402:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813172.937492:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301747072 00000100:00100000:0.0:1788813172.937505:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301747072 00000100:00100000:0.0:1788813172.937594:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:0.0:1788813172.937607:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50683450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+66:12443:x1875706301747072:12345-192.168.202.13@tcp:103:lfs.0 00010000:00010000:0.0:1788813172.937627:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813172.937660:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7038c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299e5 expref: 66 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.937687:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:0.0:1788813172.937693:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813172.937765:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50683450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+65:12443:x1875706301747072:12345-192.168.202.13@tcp:103:lfs.0 Request processed in 161us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813172.937775:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:2.0:1788813172.943385:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813172.943485:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301747200 00000100:00100000:0.0:1788813172.943500:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301747200 00000100:00100000:0.0:1788813172.943579:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 229 00000100:00100000:0.0:1788813172.943592:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+65:12443:x1875706301747200:12345-192.168.202.13@tcp:58:lfs.0 00010000:00010000:0.0:1788813172.943757:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031600/0xf32533d6ff703984 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.943780:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031600/0xf32533d6ff703984 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.943792:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031600/0xf32533d6ff703984 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813172.944081:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788813172.944224:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+65:12443:x1875706301747200:12345-192.168.202.13@tcp:58:lfs.0 Request processed in 634us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813172.944233:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 229 00000100:00100000:2.0:1788813172.947094:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813172.947203:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301747328 00000100:00100000:0.0:1788813172.947215:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301747328 00000100:00100000:0.0:1788813172.947290:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 230 00000100:00100000:0.0:1788813172.947303:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+65:12443:x1875706301747328:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813172.947331:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813172.947360:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031a00/0xf32533d6ff70398b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a1d expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.947434:0:12571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031600/0xf32533d6ff703984 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.947447:0:12571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031a00/0xf32533d6ff70398b lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a1d expref: 66 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.947471:0:12571:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031600/0xf32533d6ff703984 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.947511:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031a00/0xf32533d6ff70398b lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a1d expref: 66 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.947529:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:0.0:1788813172.947533:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813172.947537:0:12571:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031a00/0xf32533d6ff70398b lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a1d expref: 66 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.947545:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a40031a00, rc 0) 00000100:00100000:0.0:1788813172.947630:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+66:12443:x1875706301747328:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 330us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813172.947638:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 230 00000040:00080000:0.0:1788813172.964194:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813172.964205:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813172.964253:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788813172.964264:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788813172.964460:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944171880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875706313319296:192.168.202.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788813172.964578:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943613d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813172.970179:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944171880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875706313319296:192.168.202.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788813172.972381:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813172.972917:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301747456 00000100:00100000:3.0:1788813172.972978:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301747456 00000100:00100000:2.0:1788813172.975721:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 231 00000100:00100000:2.0:1788813172.975748:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+66:12444:x1875706301747456:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788813172.975784:0:9156:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788813172.975972:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+66:12444:x1875706301747456:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 Request processed in 194us (3560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813172.975981:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 231 00000100:00100000:2.0:1788813172.980037:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813172.980112:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301747584 00000100:00100000:0.0:1788813172.980128:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301747584 00000100:00100000:0.0:1788813172.980211:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 232 00000100:00100000:0.0:1788813172.980224:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+66:12444:x1875706301747584:12345-192.168.202.13@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788813172.980486:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff703992 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980533:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff703992 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980549:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff703992 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980570:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031400/0xf32533d6ff703999 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980578:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031400/0xf32533d6ff703999 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980586:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031400/0xf32533d6ff703999 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980617:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980627:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980635:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813172.980703:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788813172.980710:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813172.980726:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980740:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff703992 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980760:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff703992 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980768:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff703992 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980776:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40031200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813172.980781:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff703992 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980791:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff703992 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980806:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6fe40300) 00010000:00010000:0.0:1788813172.980809:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813172.980816:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff703992 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980823:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff703992 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980841:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031400/0xf32533d6ff703999 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980858:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031400/0xf32533d6ff703999 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980865:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031400/0xf32533d6ff703999 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980870:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40031400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813172.980880:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031400/0xf32533d6ff703999 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980887:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031400/0xf32533d6ff703999 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980895:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff948a74a15c00) 00010000:00010000:0.0:1788813172.980898:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813172.980901:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031400/0xf32533d6ff703999 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980908:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031400/0xf32533d6ff703999 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980924:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980985:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980993:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.980998:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40031c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813172.981001:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.981008:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.981017:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:0.0:1788813172.981020:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813172.981031:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813172.981037:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813172.981152:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+66:12444:x1875706301747584:12345-192.168.202.13@tcp:34:lhsmtool_posix.0 Request processed in 929us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813172.981161:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 232 00000100:00100000:2.0:1788813172.987150:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813172.987458:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301747840 00000100:00100000:3.0:1788813172.987472:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301747840 00000100:00100000:3.0:1788813172.987606:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 233 00000100:00100000:3.0:1788813172.987620:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+66:12444:x1875706301747840:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813172.987649:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813172.987677:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff7039a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a24 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.987829:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7039ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.987858:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7039ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.987876:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7039ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813172.987889:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788813172.988044:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7039ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.988054:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7039ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.988061:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7039ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.988090:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813172.988095:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7039ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.988103:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7039ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.988118:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:3.0:1788813172.988121:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788813172.988127:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7039ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.988133:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff7039ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.988207:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff7039a7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a24 expref: 68 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.988220:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6fe40300) 00010000:00010000:3.0:1788813172.988222:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813172.988227:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff7039a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a24 expref: 68 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813172.988239:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656c00, rc 0) 00000100:00100000:3.0:1788813172.988330:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+67:12444:x1875706301747840:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 712us (1195us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1788813172.988338:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 233 00000100:00100000:2.0:1788813172.994652:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813172.995290:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301747968 00000100:00100000:0.0:1788813172.995302:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301747968 00000100:00100000:0.0:1788813172.995443:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 234 00000100:00100000:0.0:1788813172.995456:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+67:12444:x1875706301747968:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788813172.995507:0:9156:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788813172.995646:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+67:12444:x1875706301747968:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 Request processed in 193us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813172.995653:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 234 00000100:00100000:2.0:1788813173.004208:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813173.004974:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301748224 00000100:00100000:0.0:1788813173.004989:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301748224 00000100:00100000:0.0:1788813173.005071:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 235 00000100:00100000:0.0:1788813173.005083:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+67:12444:x1875706301748224:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813173.005112:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813173.005116:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788813173.005152:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f600/0xf32533d6ff70394c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a08 expref: 67 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.005464:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:0.0:1788813173.005470:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813173.005508:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039bc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a2b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813173.006633:0:6496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788813173.006829:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031400/0xf32533d6ff7039c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.006855:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031400/0xf32533d6ff7039c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.006869:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031400/0xf32533d6ff7039c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.006928:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a2b expref: 69 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.006974:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031400/0xf32533d6ff7039c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a2b expref: 68 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.006983:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948a74a15c00) 00010000:00010000:0.0:1788813173.006987:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813173.006990:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a40031400, rc 0) 00000100:00100000:0.0:1788813173.007087:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+68:12444:x1875706301748224:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 2005us (2891us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788813173.007096:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 235 00000100:00100000:2.0:1788813173.017026:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813173.017163:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301748480 00000100:00100000:0.0:1788813173.017187:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301748480 00000100:00100000:0.0:1788813173.017273:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 236 00000100:00100000:0.0:1788813173.017286:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+68:12444:x1875706301748480:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788813173.017400:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813173.017439:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031400/0xf32533d6ff7039c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a2b expref: 68 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017463:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948a74a15c00) 00010000:00010000:0.0:1788813173.017478:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813173.017505:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017523:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017536:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017553:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff7039d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xd3900088 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017561:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff7039d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd3900088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017568:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff7039d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd3900088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017629:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017637:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039d1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017644:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017657:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40031c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813173.017662:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017670:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017679:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:0.0:1788813173.017682:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813173.017687:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039d1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017692:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff7039d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017703:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff7039d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd3900088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017709:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff7039d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd3900088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017715:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff7039d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd3900088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017721:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40031200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813173.017724:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff7039d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd3900088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017730:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff7039d8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd3900088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017749:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xd3900088 (ffff948a74a15a00) 00010000:00010000:0.0:1788813173.017752:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813173.017756:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff7039d8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd3900088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.017763:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff7039d8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd3900088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813173.017877:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+67:12444:x1875706301748480:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 593us (866us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813173.017885:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 236 00000100:00100000:2.0:1788813173.023414:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.023557:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301748608 00000100:00100000:1.0:1788813173.023571:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301748608 00000100:00100000:1.0:1788813173.023656:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 237 00000100:00100000:1.0:1788813173.023669:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a74a2dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+67:12444:x1875706301748608:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813173.023718:0:12571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813173.023750:0:12571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7039df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a32 expref: -99 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.023801:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff7039e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.023818:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff7039e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.023833:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff7039e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.024138:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7039df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a32 expref: 69 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.024155:0:12571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff7039e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a32 expref: 68 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.024164:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948a429ccf00) 00010000:00010000:1.0:1788813173.024167:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788813173.025244:0:12571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dad800, rc 0) 00000100:00100000:1.0:1788813173.025340:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a74a2dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+68:12444:x1875706301748608:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 1670us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813173.025350:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 237 00000100:00100000:3.0:1788813173.031714:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.031835:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301748864 00000100:00100000:1.0:1788813173.031856:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301748864 00000100:00100000:1.0:1788813173.032054:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 238 00000100:00100000:1.0:1788813173.032065:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+68:12444:x1875706301748864:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788813173.032151:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7039ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.032169:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7039ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.032183:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7039ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788813173.032497:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1788813173.032508:0:6496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 326051575782ns, next at 327051572494ns, rc = 0 00000004:00010000:1.0:1788813173.032555:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000881b0151 reply state 000000008e59727d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7039ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.032568:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7039ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.032577:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948a429ccf00) 00010000:00010000:1.0:1788813173.032592:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788813173.032597:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788813173.033177:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+70:12444:x1875706301748864:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 1112us (1470us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788813173.033186:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 238 00000100:00100000:2.0:1788813173.036074:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.036150:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301748992 00000100:00100000:1.0:1788813173.036166:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301748992 00000100:00100000:1.0:1788813173.036516:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 239 00000100:00100000:1.0:1788813173.036531:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+70:12444:x1875706301748992:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813173.036554:0:9156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813173.036576:0:9156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7039f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a39 expref: -99 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.036656:0:9156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7039f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a39 expref: 71 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.036671:0:9156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7039f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a39 expref: 71 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.036692:0:9156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948a429ccf00) 00010000:00010000:1.0:1788813173.036695:0:9156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813173.036699:0:9156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dace00, rc 0) 00000100:00100000:1.0:1788813173.037156:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+71:12444:x1875706301748992:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 628us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813173.037163:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 239 00000100:00100000:2.0:1788813173.041137:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813173.041284:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301749120 00000100:00100000:3.0:1788813173.041299:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301749120 00000100:00080000:0.0:1788813173.041387:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813173.041413:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 70 00000100:00100000:3.0:1788813173.041429:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2397:x1875706301749120:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788813173.041976:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+10:2397:x1875706301749120:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 Request processed in 549us (853us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788813173.041988:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 70 00000100:00100000:2.0:1788813173.049376:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813173.049528:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301749376 00000100:00100000:3.0:1788813173.049544:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301749376 00000100:00100000:3.0:1788813173.049623:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 60 00000100:00100000:3.0:1788813173.049636:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+71:12444:x1875706301749376:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788813173.050006:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+72:12444:x1875706301749376:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 371us (644us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788813173.050015:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 60 00000100:00100000:2.0:1788813173.053721:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.053836:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301749632 00000100:00100000:1.0:1788813173.053857:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301749632 00000100:00100000:1.0:1788813173.053984:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 240 00000100:00100000:1.0:1788813173.053998:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+72:12444:x1875706301749632:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788813173.054150:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+72:12444:x1875706301749632:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 154us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813173.054157:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 240 00000100:00100000:2.0:1788813173.063108:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.063241:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301749760 00000100:00100000:1.0:1788813173.063257:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301749760 00000100:00100000:1.0:1788813173.063438:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 241 00000100:00100000:1.0:1788813173.063453:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+72:12444:x1875706301749760:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813173.063483:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813173.063561:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7039fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a40 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.063665:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703a02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.063684:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703a02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.063699:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703a02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813173.063763:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788813173.063792:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703a02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.063856:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac600/0xf32533d6ff7039fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a40 expref: 74 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.063882:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703a02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a40 expref: 73 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.063892:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948a429ccf00) 00010000:00010000:1.0:1788813173.063897:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788813173.063901:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac000, rc 0) 00000100:00100000:1.0:1788813173.064133:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+73:12444:x1875706301749760:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 683us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813173.064141:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 241 00000100:00100000:2.0:1788813173.068569:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.068713:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301749888 00000100:00100000:1.0:1788813173.068730:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301749888 00000100:00100000:1.0:1788813173.068874:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 71 00000100:00100000:1.0:1788813173.068884:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+10:2396:x1875706301749888:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813173.068907:0:14190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813173.068959:0:14190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df28b737/0xf32533d6ff703a09 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a47 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813173.068987:0:14190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f1f75, blocks: 0x0 00010000:00010000:1.0:1788813173.069010:0:14190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=326s v=(0 0) 00010000:00010000:1.0:1788813173.069014:0:14190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813173.069022:0:14190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df28b737/0xf32533d6ff703a09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a47 expref: 11 pid: 14190 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.069041:0:14190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df28b737/0xf32533d6ff703a09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a47 expref: 11 pid: 14190 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.069053:0:14190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac600, rc 0) 00000100:00100000:1.0:1788813173.069123:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+11:2396:x1875706301749888:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 240us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813173.069132:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 71 00000100:00100000:2.0:1788813173.072383:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.072512:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301750144 00000100:00100000:1.0:1788813173.072524:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301750144 00000100:00100000:1.0:1788813173.072586:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 242 00000100:00100000:1.0:1788813173.072594:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+73:12444:x1875706301750144:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788813173.072740:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+73:12444:x1875706301750144:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 145us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813173.072749:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 242 00000100:00100000:3.0:1788813173.075895:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813173.076117:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301750272 00000100:00100000:0.0:1788813173.076131:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301750272 00000100:00100000:0.0:1788813173.076203:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:0.0:1788813173.076215:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+11:12444:x1875706301750272:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813173.076240:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813173.076265:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d275eba/0xf32533d6ff703a10 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a4e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.076307:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df28b737/0xf32533d6ff703a09 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a47 expref: 12 pid: 14190 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.076327:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813173.076332:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813173.076339:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d275eba/0xf32533d6ff703a10 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a4e expref: 12 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.076405:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df28b737/0xf32533d6ff703a09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a47 expref: 12 pid: 14190 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.076423:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df28b737/0xf32533d6ff703a09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a47 expref: 12 pid: 14190 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813173.076440:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944171880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1875706313319424:192.168.202.13@tcp:104: 00000100:00100000:0.0:1788813173.076553:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943613f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813173.080914:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944171880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1875706313319424:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813173.081003:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007d275eba/0xf32533d6ff703a10 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a4e expref: 12 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.081116:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a40031200, rc 0) 00000100:00100000:0.0:1788813173.081234:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+12:12444:x1875706301750272:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 5020us (5353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813173.081246:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:2.0:1788813173.082871:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813173.083054:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301750400 00000100:00100000:0.0:1788813173.083067:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301750400 00010000:00010000:0.0:1788813173.083119:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df28b737/0xf32533d6ff703a09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a47 expref: 12 pid: 14190 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813173.083164:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 101 00000100:00100000:0.0:1788813173.083176:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+12:2397:x1875706301750400:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813173.083218:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813173.083250:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df28b737/0xf32533d6ff703a09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a47 expref: 12 pid: 14190 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.083267:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df28b737/0xf32533d6ff703a09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a47 expref: 12 pid: 14190 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.083297:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df28b737/0xf32533d6ff703a09 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a47 expref: 12 pid: 14190 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.083320:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813173.083325:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813173.083335:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d275eba/0xf32533d6ff703a10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a4e expref: 11 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.083347:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d275eba/0xf32533d6ff703a10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a4e expref: 11 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.083395:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007d275eba/0xf32533d6ff703a10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a4e expref: 11 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813173.083414:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944171880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6480:1875706313319552:192.168.202.13@tcp:105: 00000100:00100000:0.0:1788813173.083509:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943613f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813173.085927:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944171880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6480:1875706313319552:192.168.202.13@tcp:105: 00010000:00010000:0.0:1788813173.086180:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813173.086575:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+11:2397:x1875706301750400:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 3398us (3710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813173.086589:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 101 00000100:00100000:2.0:1788813173.088207:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813173.088265:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301750528 00000100:00100000:0.0:1788813173.088280:0:8410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301750528 00002000:00100000:0.0:1788813173.088365:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9489443b6680 x1875706301750528/t0(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:744/0 lens 504/0 e 0 to 0 dl 1788813184 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813173.088378:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9489443b6680 with x1875706301750528 ext(0->12) 00002000:00010000:0.0:1788813173.088385:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9489443b6680 00000100:00100000:0.0:1788813173.088428:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00100000:0.0:1788813173.088441:0:8410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+11:2396:x1875706301750528:12345-192.168.202.13@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788813173.090390:0:8410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+13:2396:x1875706301750528:12345-192.168.202.13@tcp:4:lhsmtool_posix.0 Request processed in 1939us (2184us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788813173.090404:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 6 00002000:00100000:0.0:1788813173.090416:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9489443b6680 x1875706301750528/t4294967321(0) o4->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:744/0 lens 504/448 e 0 to 0 dl 1788813184 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813173.090427:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9489443b6680 with x1875706301750528 ext(0->12) 00002000:00010000:0.0:1788813173.090434:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9489443b6680 00000100:00100000:2.0:1788813173.092228:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313319680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813173.092302:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813173.092407:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313319680 00000100:00100000:0.0:1788813173.092416:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313319680 00000100:00100000:0.0:1788813173.092472:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788813173.092480:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313319680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788813173.092506:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813173.092570:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313319680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813173.092599:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1788813173.092665:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813173.092706:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313319680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813173.092873:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813173.092884:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313319808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813173.092916:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813173.093119:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313319808 00000100:00100000:1.0:1788813173.093125:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313319808 00000100:00100000:1.0:1788813173.093174:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788813173.093182:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313319808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813173.093195:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813173.093239:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313319808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813173.093244:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788813173.093327:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313319808:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788813173.093472:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813173.094004:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.094073:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301750656 00000100:00100000:1.0:1788813173.094077:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301750656 00000100:00100000:1.0:1788813173.094118:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 243 00000100:00100000:1.0:1788813173.094126:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+73:12444:x1875706301750656:12345-192.168.202.13@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788813173.097322:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1788813173.097352:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00010000:00010000:0.0:1788813173.097370:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff703715 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097388:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff703715 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097396:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff703715 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097405:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad400 already unused, calling callback (ffffffffc19d24f0) 00000004:00080000:3.0:1788813173.097409:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:0.0:1788813173.097411:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff703715 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097422:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff703715 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788813173.097439:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff948a50c0f780 refcount 2 committed 0 result 0 batchid 7 00010000:00010000:0.0:1788813173.097444:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948943001200) 00000020:00080000:3.0:1788813173.097445:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948a6ed19500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff948a50c0fb40 00000020:00080000:3.0:1788813173.097449:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948a6ed19300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff948942059800 00000004:00080000:3.0:1788813173.097476:0:6472:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788813173.097495:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9489435a4840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788813173.097496:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948a6ed19600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9489435a4f00 00000020:00080000:3.0:1788813173.097513:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948a6ed19200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff948a42be1c00 00010000:00010000:0.0:1788813173.097523:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813173.097531:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff703715 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788813173.097536:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00010000:00010000:0.0:1788813173.097540:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad400/0xf32533d6ff703715 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097582:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff7037bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097589:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff7037bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097595:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff7037bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097610:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813173.097615:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff7037bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788813173.097621:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:0.0:1788813173.097622:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff7037bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097639:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948a74a15500) 00010000:00010000:0.0:1788813173.097643:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813173.097646:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff7037bd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097652:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff7037bd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097673:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70383b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097681:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70383b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097689:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70383b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097695:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdbc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813173.097698:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70383b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097704:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70383b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097726:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15200) 00010000:00010000:0.0:1788813173.097728:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813173.097732:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70383b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097738:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70383b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097758:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff70385e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097765:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff70385e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097771:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff70385e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097776:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813173.097780:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff70385e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097789:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff70385e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097800:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a74a15200) 00010000:00010000:0.0:1788813173.097802:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788813173.097814:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313320064:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788813173.097818:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff70385e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097833:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac800/0xf32533d6ff70385e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097874:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703930 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097880:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703930 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097887:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703930 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097891:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166fc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813173.097895:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703930 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097901:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703930 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097910:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:0.0:1788813173.097913:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813173.097917:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703930 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.097922:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff703930 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813173.097969:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813173.098014:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313320192:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788813173.098014:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7039ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813173.098028:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813173.098037:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313319936:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788813173.098040:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7039ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.098050:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7039ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813173.098066:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813173.098075:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813173.098080:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7039ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.098088:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7039ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813173.098103:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313320064 00010000:00010000:0.0:1788813173.098104:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948a429ccf00) 00000100:00100000:1.0:1788813173.098106:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313319936 00010000:00010000:0.0:1788813173.098113:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788813173.098114:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313320064 00000100:00100000:1.0:1788813173.098114:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313319936 00010000:00010000:0.0:1788813173.098117:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7039ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.098126:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad000/0xf32533d6ff7039ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788813173.098255:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813173.098312:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788813173.100173:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813173.100257:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313320192 00000100:00100000:3.0:1788813173.100266:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313320192 00000100:00100000:3.0:1788813173.100324:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788813173.100335:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313320192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788813173.100377:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1788813173.100421:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f1f74, atime: 0x6a9f1f74, ctime: 0x6a9f1f74, blocks: 0x8 00010000:00010000:3.0:1788813173.100431:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fd5d88/0xf32533d6ff703a17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.100452:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1788813173.100457:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813173.100465:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fd5d88/0xf32533d6ff703a17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.100485:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fd5d88/0xf32533d6ff703a17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.100497:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fd5d88/0xf32533d6ff703a17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.100506:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fd5d88/0xf32533d6ff703a17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.100569:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788813173.100773:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3627:x1875706313320192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 439us (615us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788813173.100781:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1788813173.100810:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813173.100818:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fd5d88/0xf32533d6ff703a17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.100827:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656c00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813173.100832:0:7900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fd5d88/0xf32533d6ff703a17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.100843:0:7900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fd5d88/0xf32533d6ff703a17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.100873:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fd5d88/0xf32533d6ff703a17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.100882:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fd5d88/0xf32533d6ff703a17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.100905:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813173.100907:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813173.100908:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788813173.100986:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9489443b6300/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788813173.100997:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313320192:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788813173.101579:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788813173.101591:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3626:x1875706313320064:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788813173.101716:0:10066:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788813173.101720:0:10066:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788813173 00002000:00010000:2.0:1788813173.101723:0:10066:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788813173.101726:0:10066:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788813173 -> 1788813173 00002000:00010000:2.0:1788813173.101729:0:10066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788813173.101807:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3626:x1875706313320064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 219us (3842us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788813173.101815:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:0.0:1788813173.101996:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94894424fb80/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788813173.102004:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313320064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788813173.102268:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12444:x1875706301750656:12345-192.168.202.13@tcp:44:lhsmtool_posix.0 Request processed in 8139us (8264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813173.102280:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 243 00000100:00100000:1.0:1788813173.102908:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3626:x1875706313319936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788813173.103092:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1788813173.103117:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff703a1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.103142:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f84a575/0xf32533d6ff7037cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299a6 expref: 12 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.103730:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788813173.103736:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813173.103741:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff703a1e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.103789:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f84a575/0xf32533d6ff7037cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299a6 expref: 12 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.103807:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f84a575/0xf32533d6ff7037cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299a6 expref: 12 pid: 8404 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813173.103839:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1875706313320320:192.168.202.13@tcp:104: 00000100:00100000:1.0:1788813173.103977:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4540 going to sleep for 11 seconds 00000100:00100000:1.0:1788813173.106747:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1875706313320320:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813173.106792:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff703a1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813173.109528:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.109709:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301750784 00000100:00100000:1.0:1788813173.109721:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301750784 00010000:00010000:1.0:1788813173.109777:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f84a575/0xf32533d6ff7037cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299a6 expref: 13 pid: 8404 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813173.109871:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 102 00000100:00100000:1.0:1788813173.109884:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+13:2397:x1875706301750784:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813173.109926:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813173.109959:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f84a575/0xf32533d6ff7037cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299a6 expref: 13 pid: 8404 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.109974:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f84a575/0xf32533d6ff7037cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299a6 expref: 13 pid: 8404 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.110005:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f84a575/0xf32533d6ff7037cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299a6 expref: 13 pid: 8404 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.110028:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813173.110033:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813173.110040:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff703a1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.110051:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff703a1e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.110087:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813173.110165:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+12:2397:x1875706301750784:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 279us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813173.110172:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 102 00010000:00010000:3.0:1788813173.110584:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff703a1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.110595:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff703a1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.110604:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff703a1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.110610:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff703a1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.110629:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788813173.110881:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3626:x1875706313319936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12557us (12819us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788813173.110891:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:3.0:1788813173.110979:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94894424ed80/2, rc 0, transno 4294967323 00000100:00100000:3.0:1788813173.110987:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313319936:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788813173.111091:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813173.111099:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff703a1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.111106:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dade00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813173.111110:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff703a1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.111118:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff703a1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.111130:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff703a1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.111135:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c6eb49f/0xf32533d6ff703a1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.111165:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813173.111167:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813173.111168:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813173.112045:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813173.112363:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301750912 00000100:00100000:3.0:1788813173.112373:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301750912 00000100:00100000:3.0:1788813173.112440:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 76 00000100:00100000:3.0:1788813173.112451:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+12:2397:x1875706301750912:12345-192.168.202.13@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788813173.115532:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1788813173.115616:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1788813173.116221:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2397:x1875706301750912:12345-192.168.202.13@tcp:16:lhsmtool_posix.0 Request processed in 3763us (4190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813173.116232:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 76 00000100:00100000:2.0:1788813173.119216:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.119291:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301751168 00000100:00100000:1.0:1788813173.119303:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301751168 00000100:00100000:1.0:1788813173.119432:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 244 00000100:00100000:1.0:1788813173.119445:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12444:x1875706301751168:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788813173.119530:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813173.120879:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac000/0xf32533d6ff703a02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a40 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.120912:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948a429ccf00) 00010000:00010000:1.0:1788813173.120919:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813173.121002:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff703a25 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.121021:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff703a25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.121034:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff703a25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813173.121488:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa49e326 reply state 000000008ee6e2b3 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff703a25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.121501:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff703a25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.121505:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948a429ccf00) 00010000:00010000:1.0:1788813173.121507:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788813173.121510:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788813173.121697:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:12444:x1875706301751168:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 2255us (2542us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1788813173.121705:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 244 00000100:00100000:0.0:1788813173.123415:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813173.123563:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301751296 00000100:00100000:2.0:1788813173.123576:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301751296 00000100:00100000:2.0:1788813173.123640:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 77 00000100:00100000:2.0:1788813173.123649:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2397:x1875706301751296:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788813173.123824:0:10066:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788813173.123828:0:10066:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788813173 -> 1788813173 00002000:00010000:2.0:1788813173.123832:0:10066:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788813172 00002000:00010000:2.0:1788813173.123834:0:10066:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788813173 -> 1788813173 00002000:00010000:2.0:1788813173.123836:0:10066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788813173.123921:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2397:x1875706301751296:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 Request processed in 271us (514us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788813173.124280:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 77 00000100:00100000:2.0:1788813173.126335:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813173.126428:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301751552 00000100:00100000:3.0:1788813173.126441:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301751552 00000100:00100000:3.0:1788813173.126510:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 245 00000100:00100000:3.0:1788813173.126519:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:12444:x1875706301751552:12345-192.168.202.13@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788813173.126614:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.126631:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff7039e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a32 expref: 22 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.126639:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a2c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.126676:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff7039e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a32 expref: 22 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.126689:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff7039e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a32 expref: 22 pid: 12571 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813173.126703:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313320448:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813173.126814:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788813173.129639:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313320448:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813173.129674:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813173.130266:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.130406:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301751680 00000100:00100000:1.0:1788813173.130416:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301751680 00010000:00010000:1.0:1788813173.130466:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff7039e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a32 expref: 23 pid: 12571 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813173.130529:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 103 00000100:00100000:1.0:1788813173.130538:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+23:2397:x1875706301751680:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813173.130560:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813173.130568:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff7039e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a32 expref: 23 pid: 12571 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.130582:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff7039e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a32 expref: 23 pid: 12571 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.130613:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dad800/0xf32533d6ff7039e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a32 expref: 23 pid: 12571 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.130638:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948a429ccf00) 00010000:00010000:1.0:1788813173.130645:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.130657:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.130668:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a2c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.130988:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813173.131056:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:2397:x1875706301751680:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 518us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813173.131063:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 103 00010000:00010000:3.0:1788813173.132062:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.132076:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.132148:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.132157:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a2c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.132233:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.132241:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813173.132246:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.132255:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a2c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.132270:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948a429ccf00) 00010000:00010000:3.0:1788813173.132273:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788813173.132278:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a2c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.132285:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a2c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813173.132381:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12444:x1875706301751552:12345-192.168.202.13@tcp:55:lhsmtool_posix.0 Request processed in 5860us (6054us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788813173.132391:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 245 00000100:00100000:2.0:1788813173.134455:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813173.134531:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301751808 00000100:00100000:3.0:1788813173.134542:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301751808 00000100:00100000:3.0:1788813173.134668:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 78 00000100:00100000:3.0:1788813173.134692:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2397:x1875706301751808:12345-192.168.202.13@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788813173.134747:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000008138f37/0xf32533d6ff703a33 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.134772:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d275eba/0xf32533d6ff703a10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a4e expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.134783:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813173.134788:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813173.134794:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008138f37/0xf32533d6ff703a33 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.134839:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d275eba/0xf32533d6ff703a10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a4e expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.134869:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d275eba/0xf32533d6ff703a10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a4e expref: 8 pid: 8404 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813173.134889:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1875706313320576:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813173.135002:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788813173.137013:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1875706313320576:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813173.137229:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000008138f37/0xf32533d6ff703a33 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813173.137322:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.137412:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301751936 00000100:00100000:1.0:1788813173.137438:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301751936 00010000:00010000:1.0:1788813173.137475:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d275eba/0xf32533d6ff703a10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a4e expref: 9 pid: 8404 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813173.137510:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 104 00000100:00100000:1.0:1788813173.137517:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+9:2396:x1875706301751936:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813173.137532:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813173.137561:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d275eba/0xf32533d6ff703a10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a4e expref: 9 pid: 8404 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.137571:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d275eba/0xf32533d6ff703a10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a4e expref: 9 pid: 8404 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.137593:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d275eba/0xf32533d6ff703a10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a4e expref: 9 pid: 8404 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.137609:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813173.137612:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813173.137617:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008138f37/0xf32533d6ff703a33 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.137624:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008138f37/0xf32533d6ff703a33 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.137639:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813173.137686:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2396:x1875706301751936:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 169us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813173.137699:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 104 00010000:00010000:2.0:1788813173.137994:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000008138f37/0xf32533d6ff703a33 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.138003:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008138f37/0xf32533d6ff703a33 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.138366:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000008138f37/0xf32533d6ff703a33 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.138374:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008138f37/0xf32533d6ff703a33 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.138392:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008138f37/0xf32533d6ff703a33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.138397:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813173.138400:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008138f37/0xf32533d6ff703a33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.138407:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008138f37/0xf32533d6ff703a33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.138596:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008138f37/0xf32533d6ff703a33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.138604:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008138f37/0xf32533d6ff703a33 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813173.138659:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2397:x1875706301751808:12345-192.168.202.13@tcp:1:lhsmtool_posix.0 Request processed in 3968us (4214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813173.138664:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 78 00000100:00100000:0.0:1788813173.145546:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813173.145647:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301752192 00000100:00100000:2.0:1788813173.145659:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301752192 00000100:00100000:2.0:1788813173.145727:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 246 00000100:00100000:2.0:1788813173.145739:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:12444:x1875706301752192:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788813173.145844:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703a3a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.145889:0:12571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff703929 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07299fa expref: 21 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.145901:0:12571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703a3a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.146068:0:12571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff703929 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299fa expref: 21 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.146084:0:12571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff703929 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299fa expref: 21 pid: 6496 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813173.146471:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313320704:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813173.146626:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943382000 going to sleep for 11 seconds 00000100:00100000:0.0:1788813173.155015:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.155127:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301752320 00000100:00100000:1.0:1788813173.155137:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301752320 00010000:00010000:1.0:1788813173.155184:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff703929 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299fa expref: 22 pid: 6496 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813173.155231:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 105 00000100:00100000:1.0:1788813173.155239:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944171c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:2396:x1875706301752320:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813173.155256:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813173.155263:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff703929 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299fa expref: 22 pid: 6496 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.155273:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff703929 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299fa expref: 22 pid: 6496 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.155296:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dac200/0xf32533d6ff703929 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a07299fa expref: 22 pid: 6496 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.155320:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:1.0:1788813173.155327:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031a00/0xf32533d6ff70398b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a1d expref: 21 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813173.155331:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313320704:192.168.202.13@tcp:104: 00010000:00010000:1.0:1788813173.155340:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703a3a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.155350:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703a3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.155383:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703a3a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.155412:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813173.155420:0:12571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703a3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.155434:0:12571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703a3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813173.155474:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944171c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:2396:x1875706301752320:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 235us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813173.155481:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 105 00010000:00010000:2.0:1788813173.155813:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703a3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.156592:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.156611:0:12571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7039f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a39 expref: 21 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.156632:0:12571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a41 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.156675:0:12571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7039f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a39 expref: 21 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.156691:0:12571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7039f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a39 expref: 21 pid: 9156 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813173.156707:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313320832:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813173.156785:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943382780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813173.160082:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313320832:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813173.160327:0:12571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813173.160765:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.160859:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301752448 00000100:00100000:1.0:1788813173.160869:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301752448 00010000:00010000:1.0:1788813173.160915:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7039f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a39 expref: 22 pid: 9156 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813173.161123:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 106 00000100:00100000:1.0:1788813173.161135:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:2397:x1875706301752448:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813173.161157:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813173.161166:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7039f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a39 expref: 22 pid: 9156 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.161180:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7039f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a39 expref: 22 pid: 9156 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.161208:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dace00/0xf32533d6ff7039f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a39 expref: 22 pid: 9156 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.161228:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948a429ccf00) 00010000:00010000:1.0:1788813173.161234:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.161264:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.161271:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a41 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.161296:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813173.161324:0:12571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.161332:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813173.161362:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:2397:x1875706301752448:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 229us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813173.161371:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 106 00000001:00080000:2.0:1788813173.161554:0:12571:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1788813173.161689:0:12571:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788813173.161725:0:12571:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1788813173.161820:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12571:1875706313320960:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788813173.161900:0:12571:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813173.162048:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943382c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788813173.162581:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313320960 00000100:00100000:3.0:1788813173.162597:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313320960 00000100:00100000:3.0:1788813173.162689:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788813173.162700:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12571:x1875706313320960:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788813173.162806:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12571:x1875706313320960:12345-0@lo:1000:mdt00_004.0 Request processed in 109us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813173.162813:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788813173.162888:0:12571:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1788813173.162895:0:12571:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:2.0:1788813173.162918:0:12571:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94894424fb80, transno 4294967322 00000004:00080000:2.0:1788813173.163014:0:12571:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94894424ed80, transno 4294967323 00000100:00100000:2.0:1788813173.163024:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12571:1875706313320960:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788813173.163289:0:12571:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788813173.163554:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12571:1875706313321088:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788813173.163593:0:12571:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813173.163677:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943382f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788813173.163715:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313321088 00000100:00100000:3.0:1788813173.163721:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313321088 00000100:00100000:3.0:1788813173.163793:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788813173.163802:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:12571:x1875706313321088:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788813173.164133:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12571:x1875706313321088:12345-0@lo:1000:mdt00_004.0 Request processed in 332us (538us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788813173.164141:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788813173.164328:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12571:1875706313321088:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788813173.164516:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.164528:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a41 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.164538:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a41 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.164545:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813173.164550:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a41 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.164560:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a41 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.164579:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948a429ccf00) 00010000:00010000:2.0:1788813173.164583:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813173.164589:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a41 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.164614:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a41 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.164647:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031600/0xf32533d6ff703984 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.164654:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031600/0xf32533d6ff703984 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.164660:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031600/0xf32533d6ff703984 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.164665:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40031600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813173.164669:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031600/0xf32533d6ff703984 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.164675:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031600/0xf32533d6ff703984 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.164684:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:2.0:1788813173.164687:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813173.164695:0:12571:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031a00/0xf32533d6ff70398b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a1d expref: 24 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.164708:0:12571:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031a00/0xf32533d6ff70398b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a1d expref: 24 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.164718:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031a00/0xf32533d6ff70398b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a1d expref: 24 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.164766:0:12571:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031a00/0xf32533d6ff70398b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a1d expref: 24 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813173.164780:0:12571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313321216:192.168.202.13@tcp:105: 00000100:00100000:2.0:1788813173.164925:0:12571:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943382f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813173.173065:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813173.173544:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301752576 00000100:00100000:3.0:1788813173.173557:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301752576 00000100:00100000:3.0:1788813173.173628:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 61 00000100:00100000:3.0:1788813173.173641:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:12443:x1875706301752576:12345-192.168.202.13@tcp:49:lfs.0 00000100:00100000:3.0:1788813173.173825:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+25:12443:x1875706301752576:12345-192.168.202.13@tcp:49:lfs.0 Request processed in 186us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813173.173834:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 61 00000100:00100000:2.0:1788813173.174615:0:12571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12571:1875706313321216:192.168.202.13@tcp:105: 00010000:00010000:2.0:1788813173.174651:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031600/0xf32533d6ff703984 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.174666:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031600/0xf32533d6ff703984 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.174708:0:12571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a48 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.174726:0:12571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.174741:0:12571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.174753:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.174760:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a48 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.174767:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a48 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.174796:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813173.174801:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a48 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.174875:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a48 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.174893:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:2.0:1788813173.174896:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813173.174902:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a48 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.174908:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff703a48 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.174920:0:12571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703a3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.174926:0:12571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703a3a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.175335:0:12571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703a3a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.175342:0:12571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813173.175345:0:12571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703a3a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.175353:0:12571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703a3a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.175374:0:12571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:2.0:1788813173.175377:0:12571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788813173.175380:0:12571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703a3a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813173.175386:0:12571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff703a3a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813173.175584:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:12444:x1875706301752192:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 29844us (30051us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788813173.175596:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 246 00000020:00080000:2.0:1788813173.175602:0:12571:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788813173.175984:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788813173.175990:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813173.176549:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788813173.176566:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788813173.177573:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.177672:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301752832 00000100:00100000:1.0:1788813173.177683:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301752832 00000100:00100000:1.0:1788813173.177787:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 247 00000100:00100000:1.0:1788813173.177801:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:12443:x1875706301752832:12345-192.168.202.13@tcp:58:lfs.0 00000040:00080000:1.0:1788813173.178252:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788813173.178390:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:12443:x1875706301752832:12345-192.168.202.13@tcp:58:lfs.0 Request processed in 592us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813173.178398:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 247 00000100:00100000:0.0:1788813173.202297:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813173.202596:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301753088 00000100:00100000:3.0:1788813173.202612:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301753088 00000100:00100000:0.0:1788813173.203095:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 62 00000100:00100000:0.0:1788813173.203232:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a612cc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+24:12444:x1875706301753088:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788813173.203590:0:6498:0:(mdd_object.c:4199:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788813173.203642:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1788813173.203795:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff703a4f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.203816:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff703a4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.203831:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff703a4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.203842:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff703a4f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.203872:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff703a4f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.203879:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff703a4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.203908:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788813173.204252:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a612cc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+26:12444:x1875706301753088:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 1023us (1967us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788813173.204263:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 62 00000020:00080000:0.0:1788813173.204269:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788813173.205019:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813173.205042:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff703a4f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.205051:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40030400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813173.205057:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff703a4f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.205067:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff703a4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.205113:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948a429ccf00) 00010000:00010000:1.0:1788813173.205117:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788813173.205124:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff703a4f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.205131:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff703a4f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813173.205150:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813173.205152:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813173.205154:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813173.230156:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813173.230288:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301753216 00000100:00100000:3.0:1788813173.230324:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301753216 00000100:00100000:3.0:1788813173.230409:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 248 00000100:00100000:3.0:1788813173.230422:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+26:12446:x1875706301753216:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813173.230459:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813173.230490:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff703a56 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a55 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.230654:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703a5d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.230674:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703a5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.230690:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703a5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.230709:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.230716:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.230723:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.230831:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703a6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.230843:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a16 expref: 27 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.230863:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703a6b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.230915:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a16 expref: 27 pid: 9156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.231441:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a16 expref: 27 pid: 9156 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813173.231462:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313321344:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813173.231699:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788813173.238648:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813173.238766:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301753472 00000100:00100000:1.0:1788813173.238779:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301753472 00000100:00100000:1.0:1788813173.238879:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:1.0:1788813173.238892:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+28:10752:x1875706301753472:12345-192.168.202.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788813173.239257:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:10752:x1875706301753472:12345-192.168.202.13@tcp:35:ldlm_bl.0 Request processed in 366us (625us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788813173.239266:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:0.0:1788813173.240325:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1875706313321344:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813173.240365:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703a6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813173.241903:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813173.242395:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301753600 00000100:00100000:3.0:1788813173.242411:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301753600 00010000:00010000:3.0:1788813173.242473:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a16 expref: 29 pid: 9156 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813173.242523:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 107 00000100:00100000:3.0:1788813173.242535:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50680050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:2396:x1875706301753600:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813173.242665:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813173.242675:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a16 expref: 29 pid: 9156 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.242691:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a16 expref: 29 pid: 9156 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.242716:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703976 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a16 expref: 29 pid: 9156 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.242754:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:3.0:1788813173.242760:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703a6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.242770:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703a6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.242780:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703a6b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813173.243758:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813173.243881:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50680050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+28:2396:x1875706301753600:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 1344us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813173.243892:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 107 00010000:00010000:0.0:1788813173.244363:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703a6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244374:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703a6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813173.244446:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788813173.244452:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813173.244477:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703a6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244494:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703a6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244505:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703a5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244513:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703a5d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244520:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703a5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244526:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813173.244531:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703a5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244541:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703a5d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244567:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:0.0:1788813173.244585:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813173.244591:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703a5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244597:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657400/0xf32533d6ff703a5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244615:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244621:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a64 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244627:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244632:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813173.244635:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244641:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244649:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948a7b709d00) 00010000:00010000:0.0:1788813173.244652:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813173.244654:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a64 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244660:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656c00/0xf32533d6ff703a64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244707:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657a00/0xf32533d6ff703a56 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a55 expref: 28 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244736:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703a6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a55 expref: 27 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813173.244744:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:0.0:1788813173.244746:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813173.244748:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657000, rc 0) 00000100:00100000:0.0:1788813173.244790:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:12446:x1875706301753216:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 14371us (14650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813173.244798:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 248 00000100:00100000:3.0:1788813173.612523:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813173.612563:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313321472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813173.612665:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813173.612757:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313321472 00000100:00100000:3.0:1788813173.612768:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313321472 00000100:00100000:3.0:1788813173.612838:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788813173.612858:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313321472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788813173.612903:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788813173.612982:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313321472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813173.612990:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788813173.613045:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313321472:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788813173.732720:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813173.980458:0:14727:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813173.980473:0:14727:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813173.980519:0:14727:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788813173.980530:0:14727:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788813174.188458:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788813174.188475:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813174.188533:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788813174.189317:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788813174.190432:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875706313321600:192.168.202.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788813174.191419:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b72aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813174.198046:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813174.198093:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301753728 00000100:00100000:2.0:1788813174.198107:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301753728 00000100:00100000:2.0:1788813174.198191:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 249 00000100:00100000:2.0:1788813174.198203:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+28:12458:x1875706301753728:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 00000100:00100000:3.0:1788813174.198600:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875706313321600:192.168.202.13@tcp:107:hsm_cdtr.0 00000004:00000080:2.0:1788813174.199456:0:12571:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788813174.201500:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:12458:x1875706301753728:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 Request processed in 3285us (3454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813174.201518:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 249 00000100:00080000:2.0:1788813174.201571:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813174.215818:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813174.216772:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301753984 00000100:00100000:3.0:1788813174.216789:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301753984 00000100:00100000:3.0:1788813174.216907:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 250 00000100:00100000:3.0:1788813174.216919:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+27:12458:x1875706301753984:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813174.216965:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813174.216993:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703a72 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a5c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813174.217134:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703a79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813174.217152:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703a79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813174.217170:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703a79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813174.217183:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788813174.220904:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703a72 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a5c expref: 30 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813174.220960:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703a79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a5c expref: 29 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813174.220992:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:3.0:1788813174.220995:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813174.221000:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656e00, rc 0) 00000100:00100000:3.0:1788813174.221105:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:12458:x1875706301753984:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 4187us (5313us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788813174.221115:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 250 00000100:00100000:0.0:1788813174.241323:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813174.241368:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813174.241415:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301754112 00000100:00100000:0.0:1788813174.241428:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301754112 00000100:00100000:0.0:1788813174.241515:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:0.0:1788813174.241526:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944170700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:2396:x1875706301754112:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813174.241549:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813174.241582:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656e00/0xf32533d6ff703a79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a5c expref: 29 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813174.241607:0:9502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:0.0:1788813174.241614:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813174.241691:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944170700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+28:2396:x1875706301754112:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 166us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813174.241699:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:3.0:1788813174.244518:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301754368 00000100:00100000:3.0:1788813174.244603:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301754368 00000100:00100000:3.0:1788813174.244704:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 251 00000100:00100000:3.0:1788813174.244717:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+28:12458:x1875706301754368:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788813174.245922:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703a87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813174.245970:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703a87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813174.245987:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703a87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813174.252366:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703a87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813174.252393:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703a87 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813174.252409:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703a87 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813174.252430:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813174.252437:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703a87 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813174.252446:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703a87 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813174.252468:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:3.0:1788813174.252474:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788813174.252480:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703a87 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813174.252486:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703a87 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813174.255209:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:12458:x1875706301754368:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 10476us (13822us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788813174.255241:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 251 00000040:00080000:3.0:1788813174.255387:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788813174.255392:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813174.255917:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788813174.255962:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788813174.262991:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813174.263588:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301754624 00000100:00100000:1.0:1788813174.263603:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301754624 00000100:00100000:1.0:1788813174.263685:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 64 00000100:00100000:1.0:1788813174.263698:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+29:12458:x1875706301754624:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788813174.264035:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:12458:x1875706301754624:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 338us (1070us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788813174.267681:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 64 00010000:00010000:2.0:1788813174.758974:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813175.171028:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813175.171090:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813175.171113:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813175.171159:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813175.171192:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813175.171213:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813175.171307:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813175.171348:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301754752 00000100:00100000:1.0:1788813175.171361:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301754752 00000100:00100000:1.0:1788813175.171429:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 381 00000100:00100000:1.0:1788813175.171449:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2396:x1875706301754752:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813175.171555:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2396:x1875706301754752:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 112us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813175.171563:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 381 00000100:00100000:1.0:1788813175.171608:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301754880 00000100:00100000:1.0:1788813175.171612:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301754880 00000100:00100000:1.0:1788813175.171642:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301755392 00000100:00100000:1.0:1788813175.171646:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301755392 00000100:00100000:1.0:1788813175.171673:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301755008 00000100:00100000:1.0:1788813175.171675:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301755008 00000100:00100000:1.0:1788813175.171690:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301755520 00000100:00100000:1.0:1788813175.171693:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301755520 00000100:00100000:1.0:1788813175.171708:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 311 00000100:00100000:1.0:1788813175.171715:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:2396:x1875706301754880:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813175.171757:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:2396:x1875706301754880:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 41us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813175.171764:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 311 00000100:00100000:1.0:1788813175.171778:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 312 00000100:00100000:1.0:1788813175.171784:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301755392:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813175.171837:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301755392:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 42us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813175.171845:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 312 00000100:00100000:1.0:1788813175.171859:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 313 00000100:00100000:1.0:1788813175.171866:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301755008:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813175.171891:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301755008:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813175.171897:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 313 00000100:00100000:1.0:1788813175.171909:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 314 00000100:00100000:1.0:1788813175.171916:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301755520:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813175.171963:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301755520:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 47us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813175.171970:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 314 00000100:00080000:1.0:1788813175.172093:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788813175.172098:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813175.173852:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301755136 00000100:00100000:3.0:1788813175.173868:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301755136 00000100:00100000:3.0:1788813175.173964:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301755264 00000100:00100000:3.0:1788813175.173968:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301755264 00000100:00100000:3.0:1788813175.174006:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 125 00000100:00100000:3.0:1788813175.174017:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301755136:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813175.174100:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301755136:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 85us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813175.174124:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 125 00000100:00100000:1.0:1788813175.175462:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 126 00000100:00100000:1.0:1788813175.175482:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301755264:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813175.175547:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2396:x1875706301755264:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 74us (4332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813175.175555:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 126 00000100:00080000:1.0:1788813175.175583:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813175.175588:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788813175.781588:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813176.132794:0:14778:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813176.132874:0:14778:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813176.132913:0:14778:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788813176.132920:0:14778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788813176.165261:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313321728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813176.165366:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813176.165455:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813176.165464:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313321856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813176.165504:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813176.165556:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313322240:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.165591:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813176.165625:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313322752:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.165655:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813176.165684:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313323264:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.165713:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813176.165739:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788813176.165746:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313322368:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.165779:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813176.165800:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313322880:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.165843:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813176.165866:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313323392:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.165898:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813176.165956:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313321984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813176.165985:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813176.166009:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313322496:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.166034:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813176.166061:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313323008:0@lo:400:kworker.0 00000100:00100000:0.0:1788813176.166079:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313322240 00000100:00100000:3.0:1788813176.166091:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813176.166091:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313322240 00000100:00100000:3.0:1788813176.166119:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788813176.166129:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313322112:0@lo:400:kworker.0 00000100:00100000:0.0:1788813176.166148:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313322752 00000100:00100000:0.0:1788813176.166153:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313322752 00000100:00100000:3.0:1788813176.166163:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813176.166189:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313323264 00000100:00100000:0.0:1788813176.166193:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313323264 00000100:00100000:3.0:1788813176.166196:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313322624:0@lo:400:kworker.0 00000100:00100000:0.0:1788813176.166215:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313322880 00000100:00100000:0.0:1788813176.166220:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313322880 00000100:00100000:3.0:1788813176.166225:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813176.166239:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313323392 00000100:00100000:0.0:1788813176.166244:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313323392 00000100:00100000:3.0:1788813176.166248:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313323136:0@lo:400:kworker.0 00000100:00100000:0.0:1788813176.166259:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313322496 00000100:00100000:3.0:1788813176.166277:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813176.166314:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313321728 00000100:00100000:3.0:1788813176.166319:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313321728 00000100:00100000:3.0:1788813176.166353:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313321856 00000100:00100000:3.0:1788813176.166356:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313321856 00000100:00100000:3.0:1788813176.166375:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788813176.166384:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313321728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788813176.166422:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788813176.166480:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313321728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813176.166488:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788813176.166513:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788813176.166521:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1875706313321856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813176.166534:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788813176.166563:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1875706313321856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813176.166569:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788813176.166593:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788813176.166610:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313322240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.166653:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313322240:12345-0@lo:400:kworker.0 Request processed in 44us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813176.166659:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788813176.166681:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788813176.166690:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788813176.166691:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313322752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813176.166708:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313323264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.166726:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313322752:12345-0@lo:400:kworker.0 Request processed in 38us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813176.166732:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788813176.166746:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788813176.166753:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313322880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813176.166783:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313323264:12345-0@lo:400:kworker.0 Request processed in 80us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813176.166792:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788813176.166798:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875706313322880:12345-0@lo:400:kworker.0 Request processed in 45us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813176.166805:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788813176.166814:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788813176.166832:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313323392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.166850:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313322368 00000100:00100000:3.0:1788813176.166856:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313322368 00000100:00100000:1.0:1788813176.166869:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313323392:12345-0@lo:400:kworker.0 Request processed in 37us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813176.166876:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788813176.166886:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313321984 00000100:00100000:3.0:1788813176.166890:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313321984 00000100:00100000:3.0:1788813176.166903:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313322624 00000100:00100000:3.0:1788813176.166906:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313322624 00000100:00100000:3.0:1788813176.166920:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788813176.166926:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3625:x1875706313322368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.166989:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3625:x1875706313322368:12345-0@lo:400:kworker.0 Request processed in 62us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813176.166995:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788813176.167010:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788813176.167016:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313321984:12345-0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788813176.167033:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813176.167040:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788813176.167043:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788813176.167050:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788813176.167057:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313323008 00000100:00100000:1.0:1788813176.167062:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313323008 00000100:00100000:3.0:1788813176.167101:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313321984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813176.167108:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313323136 00000100:00100000:3.0:1788813176.167110:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788813176.167114:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313323136 00000100:00100000:3.0:1788813176.167131:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788813176.167142:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313322624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813176.167146:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788813176.167156:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313323008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.167179:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313322624:12345-0@lo:400:kworker.0 Request processed in 40us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813176.167187:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788813176.167205:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313323008:12345-0@lo:400:kworker.0 Request processed in 50us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813176.167213:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788813176.167219:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788813176.167229:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3627:x1875706313323136:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788813176.167236:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813176.167265:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3627:x1875706313323136:12345-0@lo:400:kworker.0 Request processed in 39us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813176.167273:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788813176.167303:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313322112 00000100:00100000:3.0:1788813176.167308:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313322112 00000100:00100000:0.0:1788813176.167368:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313322496 00000100:00100000:0.0:1788813176.167400:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788813176.167409:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313322496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813176.167452:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313322496:12345-0@lo:400:kworker.0 Request processed in 45us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813176.167459:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788813176.172962:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788813176.172995:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6422b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313322112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.173119:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6422b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313322112:12345-0@lo:400:kworker.0 Request processed in 141us (6956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813176.173127:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788813176.173242:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313322112:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.173266:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313322624:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.173286:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313323136:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.173339:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313321984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813176.173354:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313322496:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.173368:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313323008:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.173448:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313322368:0@lo:400:kworker.0 00010000:00080000:3.0:1788813176.173468:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948944173480 x1875706313322880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813176.173481:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944173480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1875706313322880:0@lo:400:kworker.0 00010000:00080000:3.0:1788813176.173498:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489443b5c00 x1875706313323392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813176.173507:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313323392:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.173522:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313322240:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.173542:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313322752:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.173563:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313323264:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.173595:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313321856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813176.173614:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313321728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813176.221378:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813176.223735:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301755776 00000100:00100000:3.0:1788813176.223752:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301755776 00000100:00100000:3.0:1788813176.223877:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 252 00000100:00100000:3.0:1788813176.223888:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+30:12478:x1875706301755776:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813176.223909:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813176.223964:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703a8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a63 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813176.224064:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff703a95 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813176.224079:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff703a95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813176.224103:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff703a95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813176.224114:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788813176.224509:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656a00/0xf32533d6ff703a8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a63 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813176.224528:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff703a95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a63 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813176.224536:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:3.0:1788813176.224540:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788813176.224543:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656200, rc 0) 00000100:00100000:3.0:1788813176.224779:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:12478:x1875706301755776:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 891us (3410us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788813176.224787:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 252 00000100:00080000:1.0:1788813176.226041:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813176.241021:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813176.241063:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301755904 00000100:00100000:0.0:1788813176.241073:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301755904 00000100:00100000:0.0:1788813176.241140:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 253 00000100:00100000:0.0:1788813176.241151:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:12478:x1875706301755904:12345-192.168.202.13@tcp:54:lfs.0 00010000:00010000:0.0:1788813176.241241:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703aa3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813176.241258:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813176.241270:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813176.241305:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813176.241313:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703aa3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813176.241319:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813176.241325:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40031c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813176.241329:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813176.241337:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703aa3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813176.241349:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:0.0:1788813176.241352:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788813176.241356:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703aa3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813176.241363:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703aa3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813176.241441:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+32:12478:x1875706301755904:12345-192.168.202.13@tcp:54:lfs.0 Request processed in 292us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813176.241449:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 253 00000100:00100000:2.0:1788813176.314906:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813176.315072:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301756032 00000100:00100000:3.0:1788813176.315082:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301756032 00000100:00100000:3.0:1788813176.315155:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 79 00000100:00100000:3.0:1788813176.315166:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2398:x1875706301756032:12345-192.168.202.13@tcp:101:cat.0 00010000:00010000:3.0:1788813176.315203:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813176.315224:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2cc7d6a/0xf32533d6ff703aaa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a6a expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813176.315249:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f1f75, atime: 0x6a9f1f74, ctime: 0x6a9f1f75, blocks: 0x8 00010000:00010000:3.0:1788813176.315268:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1788813176.315272:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813176.315282:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2cc7d6a/0xf32533d6ff703aaa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a6a expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813176.315300:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2cc7d6a/0xf32533d6ff703aaa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a6a expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813176.315313:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656a00, rc 0) 00000100:00100000:3.0:1788813176.315373:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2398:x1875706301756032:12345-192.168.202.13@tcp:101:cat.0 Request processed in 209us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813176.315380:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 79 00000100:00100000:2.0:1788813176.320882:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813176.320977:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301756160 00000100:00100000:3.0:1788813176.320988:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301756160 00002000:00100000:3.0:1788813176.321040:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff948a7ccf8000 x1875706301756160/t0(0) o3->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:747/0 lens 488/0 e 0 to 0 dl 1788813187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788813176.321050:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948a7ccf8000 with x1875706301756160 ext(0->4095) 00002000:00010000:3.0:1788813176.321056:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948a7ccf8000 00000100:00100000:3.0:1788813176.321083:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:3.0:1788813176.321106:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2399:x1875706301756160:12345-192.168.202.13@tcp:3:cat.0 00000100:00100000:3.0:1788813176.321471:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+8:2399:x1875706301756160:12345-192.168.202.13@tcp:3:cat.0 Request processed in 378us (598us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788813176.321480:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 7 00002000:00100000:3.0:1788813176.321487:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff948a7ccf8000 x1875706301756160/t0(0) o3->d2fa4f95-78d4-4e44-8582-bb12ec2edfd4@192.168.202.13@tcp:747/0 lens 488/4536 e 0 to 0 dl 1788813187 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788813176.321495:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948a7ccf8000 with x1875706301756160 ext(0->4095) 00002000:00010000:3.0:1788813176.321499:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948a7ccf8000 00010000:00010000:1.0:1788813176.807257:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788813177.704542:0:8399:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1788813177.704559:0:8399:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:2.0:1788813177.831855:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813178.213087:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788813178.213111:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313323520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813178.213192:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813178.213401:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813178.213411:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313323648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813178.213442:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813178.213482:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313323520 00000100:00100000:3.0:1788813178.213488:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313323520 00000100:00100000:3.0:1788813178.213538:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313323648 00000100:00100000:3.0:1788813178.213541:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313323648 00000100:00100000:3.0:1788813178.213557:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788813178.213565:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313323520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813178.213593:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813178.213631:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313323520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813178.213638:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788813178.213667:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788813178.213674:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313323648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788813178.213683:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813178.213711:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313323648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813178.213732:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1788813178.213750:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813178.213784:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313323648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813178.213959:0:3628:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788813178.213964:0:3628:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1788813178.213981:0:3628:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9489443b6300, transno 4294967311 00000100:00100000:2.0:1788813178.214005:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313323520:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788813178.225619:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1788813178.225669:0:6472:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff948943382c00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788813178.225675:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948a46403900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9489433820c0 00000020:00080000:3.0:1788813178.225679:0:6472:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948a46403300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94894359be00 00000020:00080000:3.0:1788813178.225701:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788813178.225742:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788813178.225831:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1788813178.225976:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff703a25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813178.225987:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff703a25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813178.226009:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff703a25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813178.226015:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dacc00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813178.226019:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff703a25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813178.226027:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff703a25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813178.226045:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948a429ccf00) 00010000:00010000:1.0:1788813178.226049:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813178.226053:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff703a25 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813178.226060:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43dacc00/0xf32533d6ff703a25 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813178.725028:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813178.725052:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313323776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813178.725119:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813178.725806:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313323776 00000100:00100000:3.0:1788813178.725815:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313323776 00000100:00100000:3.0:1788813178.725874:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788813178.725884:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313323776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788813178.725917:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788813178.726004:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313323776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813178.726012:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788813178.726300:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313323776:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1788813178.730827:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1788813178.730843:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:2.0:1788813178.855867:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813179.876260:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788813179.876632:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788813180.300792:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813180.300835:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813180.300863:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813180.300889:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813180.300908:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813180.300928:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813180.300977:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813180.301004:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301756416 00000100:00100000:0.0:1788813180.301014:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301756416 00000100:00100000:0.0:1788813180.301080:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301756928 00000100:00100000:0.0:1788813180.301084:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301756928 00000100:00100000:0.0:1788813180.301098:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301756544 00000100:00100000:0.0:1788813180.301101:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301756544 00000100:00100000:0.0:1788813180.301112:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301757056 00000100:00100000:0.0:1788813180.301114:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301757056 00000100:00100000:0.0:1788813180.301130:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 321 00000100:00100000:0.0:1788813180.301139:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:2397:x1875706301756416:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813180.301214:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:2397:x1875706301756416:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 76us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813180.301221:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 321 00000100:00100000:0.0:1788813180.301242:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 322 00000100:00100000:0.0:1788813180.301249:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301756928:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813180.301272:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301756928:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813180.301287:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 322 00000100:00100000:0.0:1788813180.301301:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 323 00000100:00100000:0.0:1788813180.301307:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301756544:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813180.301333:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301756544:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813180.301339:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 323 00000100:00100000:0.0:1788813180.301350:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 324 00000100:00100000:0.0:1788813180.301356:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301757056:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813180.301379:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301757056:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 22us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813180.301384:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 324 00000100:00100000:1.0:1788813180.301668:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301756672 00000100:00100000:1.0:1788813180.301674:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301756672 00000100:00100000:1.0:1788813180.301706:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301756800 00000100:00100000:1.0:1788813180.301709:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301756800 00000100:00100000:1.0:1788813180.301731:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 129 00000100:00100000:1.0:1788813180.301737:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301756672:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813180.301772:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301756672:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 35us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813180.301798:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 129 00000100:00100000:1.0:1788813180.301813:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 130 00000100:00100000:1.0:1788813180.301820:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a766b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2397:x1875706301756800:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813180.301847:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a766b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2397:x1875706301756800:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 28us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813180.301852:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 130 00000100:00100000:1.0:1788813180.302008:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301756288 00000100:00100000:1.0:1788813180.302012:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301756288 00000100:00100000:1.0:1788813180.302051:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 383 00000100:00100000:1.0:1788813180.302058:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a64228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2397:x1875706301756288:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813180.302083:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a64228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+13:2397:x1875706301756288:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813180.302088:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 383 00000100:00080000:3.0:1788813180.302315:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813180.302319:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813180.302322:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813180.302324:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788813180.395285:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788813180.395294:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813180.395385:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788813180.395403:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788813180.903015:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813181.284289:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313324160:0@lo:400:kworker.0 00000100:00100000:1.0:1788813181.284360:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813181.284416:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313324672:0@lo:400:kworker.0 00000100:00100000:1.0:1788813181.284439:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813181.284456:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313325184:0@lo:400:kworker.0 00000100:00100000:1.0:1788813181.284475:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813181.284497:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788813181.284503:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313324032:0@lo:400:kworker.0 00000100:00100000:1.0:1788813181.284523:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813181.284537:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313324544:0@lo:400:kworker.0 00000100:00100000:1.0:1788813181.284575:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813181.284599:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313325056:0@lo:400:kworker.0 00000100:00100000:1.0:1788813181.284619:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813181.284653:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313324672 00000100:00100000:1.0:1788813181.284661:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313324672 00000100:00100000:1.0:1788813181.284709:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313325184 00000100:00100000:1.0:1788813181.284712:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313325184 00000100:00100000:1.0:1788813181.284730:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313324032 00000100:00100000:0.0:1788813181.284891:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313324288:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.284920:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813181.284953:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313324800:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.284976:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813181.284993:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313325312:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.285012:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813181.285032:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788813181.285037:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313323904:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.285064:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813181.285085:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313324416:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.285105:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813181.285120:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313324928:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.285159:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813181.285178:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313325440:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.285199:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813181.285225:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313324544 00000100:00100000:0.0:1788813181.285228:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313324544 00000100:00100000:0.0:1788813181.285249:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313325056 00000100:00100000:0.0:1788813181.285252:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313325056 00000100:00100000:0.0:1788813181.285263:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313324288 00000100:00100000:0.0:1788813181.285266:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313324288 00000100:00100000:0.0:1788813181.285279:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788813181.285286:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313324672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.285344:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313324672:12345-0@lo:400:kworker.0 Request processed in 57us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813181.285351:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788813181.285369:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788813181.285376:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313325184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.285405:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313325184:12345-0@lo:400:kworker.0 Request processed in 30us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813181.285410:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788813181.285422:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788813181.285427:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313324544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.285453:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313324544:12345-0@lo:400:kworker.0 Request processed in 26us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813181.285458:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788813181.285470:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788813181.285476:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313325056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.285518:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313325056:12345-0@lo:400:kworker.0 Request processed in 42us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813181.285523:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788813181.285535:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788813181.285540:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313324288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.285566:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313324288:12345-0@lo:400:kworker.0 Request processed in 27us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813181.285571:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788813181.285594:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313324800 00000100:00100000:0.0:1788813181.285598:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313324800 00000100:00100000:0.0:1788813181.285622:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313325312 00000100:00100000:0.0:1788813181.285624:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313325312 00000100:00100000:0.0:1788813181.285635:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313324928 00000100:00100000:0.0:1788813181.285637:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313324928 00000100:00100000:0.0:1788813181.285648:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313325440 00000100:00100000:0.0:1788813181.285650:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313325440 00000100:00100000:0.0:1788813181.285663:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788813181.285669:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313324800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.285699:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313324800:12345-0@lo:400:kworker.0 Request processed in 29us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813181.285705:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788813181.285715:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788813181.285721:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313325312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.285764:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313325312:12345-0@lo:400:kworker.0 Request processed in 43us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813181.285779:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788813181.285791:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788813181.285803:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313324928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.285829:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313324928:12345-0@lo:400:kworker.0 Request processed in 27us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813181.285833:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788813181.285842:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788813181.285847:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313325440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.285866:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313325440:12345-0@lo:400:kworker.0 Request processed in 19us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813181.285870:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788813181.285886:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313323904 00000100:00100000:0.0:1788813181.285888:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313323904 00000100:00100000:0.0:1788813181.285910:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788813181.285917:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3625:x1875706313323904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.285964:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3625:x1875706313323904:12345-0@lo:400:kworker.0 Request processed in 46us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813181.285969:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788813181.286017:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313323904:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.286029:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313324928:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.286037:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1788813181.286042:0:3625:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1788813181.286062:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313325440:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.286071:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313324288:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.286079:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313324800:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.286087:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313325312:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.286127:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313324544:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.286136:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313325056:0@lo:400:kworker.0 00010000:00080000:0.0:1788813181.286147:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894424ca80 x1875706313324672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813181.286157:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313324672:0@lo:400:kworker.0 00010000:00080000:0.0:1788813181.286168:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894424f800 x1875706313325184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813181.286177:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313325184:0@lo:400:kworker.0 00000100:00080000:0.0:1788813181.286216:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813181.286221:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813181.286223:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813181.286225:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788813181.286502:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313324032 00000100:00100000:1.0:1788813181.286541:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788813181.286548:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313324032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813181.286589:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313324032:12345-0@lo:400:kworker.0 Request processed in 42us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813181.286595:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788813181.286624:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313324032:0@lo:400:kworker.0 00000100:00100000:3.0:1788813181.286923:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313324160 00000100:00100000:3.0:1788813181.286929:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313324160 00000100:00100000:3.0:1788813181.286973:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313324416 00000100:00100000:3.0:1788813181.286976:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313324416 00000100:00100000:3.0:1788813181.286989:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788813181.286996:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313324160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813181.287040:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313324160:12345-0@lo:400:kworker.0 Request processed in 45us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813181.287047:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788813181.287061:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788813181.287067:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313324416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813181.287100:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313324416:12345-0@lo:400:kworker.0 Request processed in 34us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813181.287106:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788813181.287305:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313325696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813181.287340:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813181.287373:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313325696 00000100:00100000:2.0:1788813181.287376:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313325696 00000100:00100000:2.0:1788813181.287402:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788813181.287408:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313325696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813181.287428:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788813181.287460:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313325696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813181.287465:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788813181.287500:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313325696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813181.287562:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813181.287569:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313325824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813181.287594:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813181.287616:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313325824 00000100:00100000:2.0:1788813181.287619:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313325824 00000100:00100000:2.0:1788813181.287640:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788813181.287646:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313325824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788813181.287666:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788813181.287699:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313325824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813181.287705:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788813181.287745:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313325824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813181.287789:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313324160:0@lo:400:kworker.0 00000100:00100000:2.0:1788813181.287823:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313324416:0@lo:400:kworker.0 00000100:00100000:3.0:1788813181.288042:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813181.288053:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313325568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813181.288081:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813181.288108:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313325568 00000100:00100000:3.0:1788813181.288112:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313325568 00000100:00100000:3.0:1788813181.288136:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788813181.288142:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313325568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813181.288586:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788813181.288634:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313325568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 492us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813181.288641:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788813181.289246:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313325568:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788813181.924202:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813182.948487:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813183.102148:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813183.102252:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301757184 00000100:00100000:2.0:1788813183.102263:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301757184 00000100:00100000:2.0:1788813183.102344:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 254 00000100:00100000:2.0:1788813183.102355:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:12123:x1875706301757184:12345-192.168.202.13@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788813183.102453:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:12123:x1875706301757184:12345-192.168.202.13@tcp:60:lhsmtool_posix.0 Request processed in 100us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813183.102460:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 254 00000100:00080000:0.0:1788813183.102626:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813183.113674:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813183.113777:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301757312 00000100:00100000:0.0:1788813183.113787:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301757312 00000100:00100000:0.0:1788813183.113863:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 255 00000100:00100000:0.0:1788813183.113874:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:12123:x1875706301757312:12345-192.168.202.13@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788813183.114003:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:12123:x1875706301757312:12345-192.168.202.13@tcp:60:lhsmtool_posix.0 Request processed in 132us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813183.114010:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 255 00000100:00080000:3.0:1788813183.114312:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788813183.118144:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813183.118495:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301757568 00000100:00100000:1.0:1788813183.118505:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301757568 00000100:00100000:1.0:1788813183.118564:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:1.0:1788813183.118574:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:12123:x1875706301757568:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788813183.122426:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:12123:x1875706301757568:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 3844us (4281us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788813183.122452:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:0.0:1788813183.332277:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313325952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813183.332376:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813183.332515:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313325952 00000100:00100000:3.0:1788813183.332524:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313325952 00000100:00100000:3.0:1788813183.332599:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788813183.332610:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313325952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788813183.332643:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788813183.332693:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313325952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813183.332701:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1788813183.332871:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813183.332910:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313325952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813183.335340:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313326080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813183.335410:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813183.335504:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313326080 00000100:00100000:3.0:1788813183.335511:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313326080 00000100:00100000:3.0:1788813183.335565:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788813183.335574:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fd78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313326080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813183.335603:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788813183.335676:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813183.336967:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fd78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313326080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1391us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813183.336977:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788813183.338774:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313326080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813183.846878:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313326208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813183.846972:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813183.847430:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313326208 00000100:00100000:1.0:1788813183.847439:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313326208 00000100:00100000:1.0:1788813183.847496:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788813183.847506:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313326208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788813183.847537:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788813183.847586:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313326208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813183.847602:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788813183.847817:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313326208:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1788813183.851468:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1788813183.851488:0:6472:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788813183.851563:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788813183.851574:0:6527:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788813183.972722:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813184.997685:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813185.418950:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813185.419142:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301757696 00000100:00100000:1.0:1788813185.419153:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301757696 00000100:00100000:1.0:1788813185.419211:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 385 00000100:00100000:1.0:1788813185.419220:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:2397:x1875706301757696:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813185.419292:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:612bc516-9aee-451d-b7c0-359fff7db073+13:2397:x1875706301757696:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 73us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813185.419300:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 385 00000100:00100000:1.0:1788813185.435884:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813185.435928:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813185.435974:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813185.435993:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813185.436019:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813185.436059:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813185.436227:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301757824 00000100:00100000:2.0:1788813185.436236:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301757824 00000100:00100000:2.0:1788813185.436297:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301757952 00000100:00100000:2.0:1788813185.436302:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301757952 00000100:00100000:2.0:1788813185.436319:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301758464 00000100:00100000:2.0:1788813185.436321:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301758464 00000100:00100000:2.0:1788813185.436331:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301758336 00000100:00100000:2.0:1788813185.436333:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301758336 00000100:00100000:2.0:1788813185.436347:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 331 00000100:00100000:2.0:1788813185.436356:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:2396:x1875706301757824:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813185.436680:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 332 00000100:00100000:0.0:1788813185.436702:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301757952:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813185.436797:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 333 00000100:00100000:3.0:1788813185.436807:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301758464:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813185.436954:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:2396:x1875706301757824:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 575us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813185.436963:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 331 00000100:00100000:2.0:1788813185.436984:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 334 00000100:00100000:2.0:1788813185.436991:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301758336:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813185.437018:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:811c25ff-4ab1-402b-924d-5308c16318af+5:2396:x1875706301758336:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 28us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813185.437024:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 334 00000100:00080000:2.0:1788813185.437053:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788813185.437057:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813185.438334:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301758208 00000100:00100000:1.0:1788813185.438345:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301758208 00000100:00100000:1.0:1788813185.438405:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301758080 00000100:00100000:1.0:1788813185.438409:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301758080 00000100:00100000:1.0:1788813185.438446:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 135 00000100:00100000:1.0:1788813185.438455:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2397:x1875706301758208:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813185.438502:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2397:x1875706301758208:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 49us (2527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813185.438509:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 135 00000100:00100000:1.0:1788813185.438523:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 136 00000100:00100000:1.0:1788813185.438529:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301758080:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813185.438567:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2396:x1875706301758080:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 38us (2548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813185.438574:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 136 00000100:00100000:0.0:1788813185.438769:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301757952:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 2080us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813185.438778:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 332 00000100:00100000:3.0:1788813185.439714:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301758464:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 2905us (3714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813185.439723:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 333 00000100:00080000:2.0:1788813185.441260:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813185.441268:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1788813185.442382:0:14976:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:33:04 (1788813184) 00010000:00010000:2.0:1788813186.020360:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813186.406772:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313326464:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.407003:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313326336:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.407075:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813186.407128:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313326848:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.407156:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813186.407177:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313327360:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.407200:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813186.407219:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313327872:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.407242:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813186.407269:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813186.407275:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313328000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813186.407303:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813186.407328:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313326336 00000100:00100000:3.0:1788813186.407343:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313326336 00000100:00100000:2.0:1788813186.407344:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313326592:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.407371:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813186.407391:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313327104:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.407421:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813186.407440:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788813186.407449:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1875706313327616:0@lo:400:kworker.0 00000100:00100000:3.0:1788813186.407458:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a48472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3625:x1875706313326336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.407487:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813186.407510:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788813186.407518:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313326720:0@lo:400:kworker.0 00000100:00100000:1.0:1788813186.410013:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813186.410050:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313328128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813186.414200:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813186.414241:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a48472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3625:x1875706313326336:12345-0@lo:400:kworker.0 Request processed in 6780us (7155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813186.414259:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788813186.414265:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313327232:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.416136:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813186.416187:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313327744:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.416218:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813186.416314:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313326848 00000100:00100000:2.0:1788813186.416321:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313326848 00000100:00100000:2.0:1788813186.416367:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313326592 00000100:00100000:2.0:1788813186.416369:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313326592 00000100:00100000:2.0:1788813186.416384:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788813186.416392:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313326848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.416441:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313326848:12345-0@lo:400:kworker.0 Request processed in 50us (9283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813186.416448:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788813186.416464:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788813186.416470:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313326592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.416494:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313326592:12345-0@lo:400:kworker.0 Request processed in 24us (9124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813186.416499:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788813186.416515:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313327360 00000100:00100000:2.0:1788813186.416518:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313327360 00000100:00100000:2.0:1788813186.416551:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313327872 00000100:00100000:2.0:1788813186.416554:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313327872 00000100:00100000:2.0:1788813186.416566:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313327232 00000100:00100000:2.0:1788813186.416568:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313327232 00000100:00100000:2.0:1788813186.416582:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313327744 00000100:00100000:2.0:1788813186.416584:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313327744 00000100:00100000:2.0:1788813186.416598:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788813186.416604:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313327360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.416887:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788813186.416897:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313327872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813186.419391:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313327104 00000100:00100000:3.0:1788813186.419413:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313327104 00000100:00100000:3.0:1788813186.419514:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313327616 00000100:00100000:3.0:1788813186.419519:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313327616 00000100:00100000:3.0:1788813186.419566:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313326720 00000100:00100000:3.0:1788813186.419570:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313326720 00000100:00100000:3.0:1788813186.419603:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788813186.419614:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313327104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.434854:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313327360:12345-0@lo:400:kworker.0 Request processed in 18240us (27642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813186.434883:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788813186.434922:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788813186.434945:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313327232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.435023:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313327232:12345-0@lo:400:kworker.0 Request processed in 95us (18894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813186.435029:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788813186.435040:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788813186.435046:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313327744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.435071:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313327744:12345-0@lo:400:kworker.0 Request processed in 25us (18852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813186.435075:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788813186.435124:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313326336:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.435138:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313326848:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.435149:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313327360:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.435160:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313327872:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.435202:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313327232:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.435212:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313327744:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.435223:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313326592:0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.435234:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813186.435248:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313328256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813186.435280:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788813186.435335:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788813186.435341:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813186.435344:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813186.435355:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313328000 00000100:00100000:2.0:1788813186.435362:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313328000 00000100:00100000:2.0:1788813186.435396:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313328256 00000100:00100000:2.0:1788813186.435399:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313328256 00000100:00100000:2.0:1788813186.435411:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788813186.435418:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1875706313328000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813186.435441:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788813186.435476:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1875706313328000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (28175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813186.435482:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788813186.435492:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788813186.435498:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313328256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813186.435507:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788813186.435534:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313328256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813186.435540:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788813186.435569:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313328000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813186.435597:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313328256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813186.435734:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788813186.435742:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875706313327616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.435777:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875706313327616:12345-0@lo:400:kworker.0 Request processed in 37us (28292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813186.435783:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788813186.435805:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788813186.435810:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313326720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813186.435836:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313326720:12345-0@lo:400:kworker.0 Request processed in 27us (21647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813186.435842:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788813186.435863:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313326720:0@lo:400:kworker.0 00010000:00080000:2.0:1788813186.435875:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a46546680 x1875706313327616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813186.435885:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1875706313327616:0@lo:400:kworker.0 00000100:00100000:1.0:1788813186.436872:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813186.437160:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313328128 00000100:00100000:2.0:1788813186.437167:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313328128 00000100:00100000:2.0:1788813186.437213:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788813186.437221:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313328128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788813186.437251:0:10058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788813186.437300:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313327104:12345-0@lo:400:kworker.0 Request processed in 17676us (29867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813186.437322:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788813186.437323:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313328128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813186.437338:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788813186.437409:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313328128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813186.441411:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313327872:12345-0@lo:400:kworker.0 Request processed in 24503us (34155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813186.441430:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788813186.441734:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813186.442523:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313326464 00000100:00100000:3.0:1788813186.442532:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313326464 00000100:00100000:3.0:1788813186.442581:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788813186.442590:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313326464:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788813186.445154:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e05c00 x1875706313327104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813186.445177:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313327104:0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.447036:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313326976:0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.447113:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813186.447171:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313327488:0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.447211:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813186.447240:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313326976 00000100:00100000:0.0:1788813186.447248:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313326976 00000100:00100000:0.0:1788813186.447306:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313327488 00000100:00100000:0.0:1788813186.447309:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313327488 00000100:00100000:0.0:1788813186.447329:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788813186.447337:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313326976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.447391:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313326976:12345-0@lo:400:kworker.0 Request processed in 54us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813186.447398:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788813186.447417:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788813186.447423:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313327488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.447450:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313327488:12345-0@lo:400:kworker.0 Request processed in 27us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813186.447455:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:0.0:1788813186.447475:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813186.447520:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313327488:0@lo:400:kworker.0 00000100:00100000:3.0:1788813186.447859:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313326464:12345-0@lo:400:kworker.0 Request processed in 5269us (6136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813186.447869:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788813186.452191:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313326464:0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.452211:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313326976:0@lo:400:kworker.0 00010000:00010000:2.0:1788813187.048097:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813188.069777:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813188.452224:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813188.452249:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313328384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813188.452319:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813188.452458:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313328384 00000100:00100000:1.0:1788813188.452466:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313328384 00000100:00100000:1.0:1788813188.452512:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788813188.452519:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313328384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788813188.452555:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813188.452588:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313328384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813188.452593:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788813188.452656:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313328384:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788813188.454713:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813188.458489:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813188.458772:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313328512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813188.458862:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813188.459017:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313328512 00000100:00100000:2.0:1788813188.459025:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313328512 00000100:00100000:2.0:1788813188.459311:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788813188.459321:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313328512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813188.459344:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788813188.459411:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313328512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813188.459426:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788813188.459657:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313328512:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788813188.459747:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813188.468488:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813188.468603:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301758592 00000100:00100000:0.0:1788813188.468614:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301758592 00000100:00100000:0.0:1788813188.468739:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 256 00000100:00100000:0.0:1788813188.468751:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+5:13151:x1875706301758592:12345-192.168.202.13@tcp:101:lsof.0 00010000:00010000:0.0:1788813188.468769:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813188.468790:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031000/0xf32533d6ff703ab1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a71 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813188.468858:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703ab8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813188.468872:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813188.468884:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813188.468928:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788813188.468954:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813188.468997:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813188.469023:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031000/0xf32533d6ff703ab1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a71 expref: 7 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813188.469058:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a71 expref: 6 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813188.469086:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764be000) 00010000:00010000:0.0:1788813188.469090:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813188.469094:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a40031c00, rc 0) 00000100:00100000:0.0:1788813188.469159:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+6:13151:x1875706301758592:12345-192.168.202.13@tcp:101:lsof.0 Request processed in 410us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813188.469165:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 256 00000100:00080000:3.0:1788813188.469700:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813188.964475:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313328640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813188.964554:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813188.965047:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313328640 00000100:00100000:3.0:1788813188.965057:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313328640 00000100:00100000:3.0:1788813188.965125:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788813188.965135:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313328640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788813188.965168:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788813188.965226:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313328640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813188.965232:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788813188.965370:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313328640:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788813189.092642:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788813189.093438:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813190.116777:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813190.536110:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813190.536154:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813190.536202:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813190.536235:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813190.536251:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813190.536266:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813190.536295:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813190.536323:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301759104 00000100:00100000:1.0:1788813190.536333:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301759104 00000100:00100000:1.0:1788813190.536386:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301759232 00000100:00100000:1.0:1788813190.536389:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301759232 00000100:00100000:1.0:1788813190.536411:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 141 00000100:00100000:1.0:1788813190.536421:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301759104:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813190.536490:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301759104:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 70us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813190.536498:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 141 00000100:00100000:1.0:1788813190.536519:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 142 00000100:00100000:1.0:1788813190.536526:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2397:x1875706301759232:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813190.536552:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2397:x1875706301759232:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813190.536557:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 142 00000100:00100000:3.0:1788813190.536829:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301758848 00000100:00100000:3.0:1788813190.536834:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301758848 00000100:00100000:3.0:1788813190.536873:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301759360 00000100:00100000:3.0:1788813190.536876:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301759360 00000100:00100000:3.0:1788813190.536891:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301758976 00000100:00100000:3.0:1788813190.536893:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301758976 00000100:00100000:3.0:1788813190.536904:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301759488 00000100:00100000:3.0:1788813190.536905:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301759488 00000100:00100000:3.0:1788813190.536918:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 341 00000100:00100000:3.0:1788813190.536925:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:2397:x1875706301758848:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813190.536998:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:2397:x1875706301758848:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 72us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813190.537004:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 341 00000100:00100000:3.0:1788813190.537021:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 342 00000100:00100000:3.0:1788813190.537038:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+6:2397:x1875706301759360:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813190.537062:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+6:2397:x1875706301759360:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 36us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813190.537068:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 342 00000100:00100000:3.0:1788813190.537080:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 343 00000100:00100000:3.0:1788813190.537086:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301758976:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813190.537125:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2397:x1875706301758976:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 38us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813190.537130:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 343 00000100:00100000:3.0:1788813190.537146:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 344 00000100:00100000:3.0:1788813190.537152:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301759488:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813190.537175:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:811c25ff-4ab1-402b-924d-5308c16318af+5:2397:x1875706301759488:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813190.537180:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 344 00000100:00080000:3.0:1788813190.537206:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813190.537209:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813190.537211:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813190.537213:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813190.537544:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301758720 00000100:00100000:0.0:1788813190.537550:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301758720 00000100:00100000:0.0:1788813190.537588:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 387 00000100:00100000:0.0:1788813190.537595:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2397:x1875706301758720:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813190.537625:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:612bc516-9aee-451d-b7c0-359fff7db073+13:2397:x1875706301758720:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 30us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813190.537631:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 387 00000040:00080000:3.0:1788813190.632453:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788813190.632464:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813190.632576:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788813190.632586:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788813191.144480:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813191.272478:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813191.272567:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301759744 00000100:00100000:3.0:1788813191.272576:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301759744 00000100:00100000:3.0:1788813191.272634:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 66 00000100:00100000:3.0:1788813191.272644:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+18:13153:x1875706301759744:12345-192.168.202.13@tcp:35:umount.0 00000100:00100000:3.0:1788813191.272896:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:13153:x1875706301759744:12345-192.168.202.13@tcp:35:umount.0 Request processed in 252us (426us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788813191.272903:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 66 00000100:00100000:0.0:1788813191.279443:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813191.279531:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301760000 00000100:00100000:3.0:1788813191.279542:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301760000 00000100:00100000:3.0:1788813191.279600:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:3.0:1788813191.279628:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+19:13153:x1875706301760000:12345-192.168.202.13@tcp:35:umount.0 00000100:00100000:3.0:1788813191.279993:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:13153:x1875706301760000:12345-192.168.202.13@tcp:35:umount.0 Request processed in 366us (560us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788813191.280002:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:1.0:1788813191.283369:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813191.283541:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301760256 00000100:00100000:3.0:1788813191.283550:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301760256 00000100:00100000:3.0:1788813191.283605:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 68 00000100:00100000:3.0:1788813191.283614:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a612cf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+20:13153:x1875706301760256:12345-192.168.202.13@tcp:35:umount.0 00000100:00100000:3.0:1788813191.283835:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a612cf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:13153:x1875706301760256:12345-192.168.202.13@tcp:35:umount.0 Request processed in 221us (472us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788813191.283850:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 68 00000100:00100000:2.0:1788813191.289286:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813191.290361:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301760512 00000100:00100000:3.0:1788813191.290374:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301760512 00000100:00100000:3.0:1788813191.290438:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 69 00000100:00100000:3.0:1788813191.290448:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:13153:x1875706301760512:12345-192.168.202.13@tcp:35:umount.0 00000100:00100000:3.0:1788813191.291922:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:13153:x1875706301760512:12345-192.168.202.13@tcp:35:umount.0 Request processed in 1467us (2639us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788813191.292035:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 69 00000100:00100000:1.0:1788813191.298277:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813191.298317:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813191.298344:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813191.298368:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813191.298458:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301760896 00000100:00100000:0.0:1788813191.298468:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301760896 00000100:00100000:0.0:1788813191.298535:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 80 00000100:00100000:0.0:1788813191.298545:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+7:2395:x1875706301760896:12345-192.168.202.13@tcp:9:umount.0 00000020:00000080:0.0:1788813191.298579:0:8404:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff703031 00000020:00010000:0.0:1788813191.298587:0:8404:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9489437d9000: total 0 00000100:00080000:0.0:1788813191.298592:0:8404:0:(import.c:65:import_set_state_nolock()) ffff9489437d8800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788813191.298650:0:8404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788813191.298819:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2395:x1875706301760896:12345-192.168.202.13@tcp:9:umount.0 Request processed in 275us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813191.298857:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 80 00000100:00100000:0.0:1788813191.298885:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301761024 00000100:00100000:0.0:1788813191.298888:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301761024 00000100:00100000:0.0:1788813191.298916:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301761280 00000100:00100000:0.0:1788813191.298919:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301761280 00000100:00100000:0.0:1788813191.298984:0:9502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301761152 00000100:00100000:0.0:1788813191.298988:0:9502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301761152 00000100:00100000:0.0:1788813191.299006:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00100000:0.0:1788813191.299013:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:612bc516-9aee-451d-b7c0-359fff7db073+15:2398:x1875706301761024:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813191.299023:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788813191.299705:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:3.0:1788813191.299718:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46546680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:612bc516-9aee-451d-b7c0-359fff7db073+15:2398:x1875706301761280:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813191.299728:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813191.299747:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e4a00/0xf32533d6ff702cf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296a4 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813191.299771:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813191.299816:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46546680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:612bc516-9aee-451d-b7c0-359fff7db073+14:2398:x1875706301761280:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 103us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813191.299824:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:3.0:1788813191.299854:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:3.0:1788813191.299862:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:612bc516-9aee-451d-b7c0-359fff7db073+13:2398:x1875706301761152:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813191.299869:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813191.299880:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e5400/0xf32533d6ff70292a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072958c expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813191.299890:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813191.299908:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:612bc516-9aee-451d-b7c0-359fff7db073+12:2398:x1875706301761152:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 47us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813191.299914:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 21 00000020:00010000:3.0:1788813191.300433:0:7900:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9489437d9000: total 0 00010000:00010000:3.0:1788813191.300504:0:7900:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9489437d9000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788813191.300549:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2cc7d6a/0xf32533d6ff703aaa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a6a expref: 4 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813191.300582:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f3530a7/0xf32533d6ff7033e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072988e expref: 3 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813191.300598:0:7900:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9489437d9000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788813191.300613:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813191.300615:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813191.300616:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813191.300770:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc09400/0xf32533d6ff702a1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07295cb expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813191.300781:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813191.300808:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:612bc516-9aee-451d-b7c0-359fff7db073+10:2398:x1875706301761024:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 1796us (2491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813191.300816:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00100000:1.0:1788813191.320840:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813191.322760:0:10066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301761408 00000100:00100000:3.0:1788813191.322773:0:10066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301761408 00000100:00100000:3.0:1788813191.322919:0:10066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 81 00000100:00100000:3.0:1788813191.323229:0:10066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2395:x1875706301761408:12345-192.168.202.13@tcp:9:umount.0 00000020:00000080:3.0:1788813191.323265:0:10066:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702dbb 00000100:00080000:3.0:1788813191.323277:0:10066:0:(import.c:65:import_set_state_nolock()) ffff948a44cc4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788813191.323330:0:10066:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:2.0:1788813191.324127:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813191.325792:0:10066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+2:2395:x1875706301761408:12345-192.168.202.13@tcp:9:umount.0 Request processed in 2855us (4952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813191.325805:0:10066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 81 00000100:00100000:2.0:1788813191.341720:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813191.346125:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301762432 00000100:00100000:3.0:1788813191.346141:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301762432 00000100:00100000:2.0:1788813191.350227:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 257 00000100:00100000:2.0:1788813191.350241:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+22:2395:x1875706301762432:12345-192.168.202.13@tcp:39:umount.0 00000020:00000080:2.0:1788813191.350273:0:9156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702938 00000020:00010000:2.0:1788813191.351425:0:9156:0:(genops.c:1920:obd_stale_export_put()) Put export ffff948942c7e000: total 0 00000100:00080000:2.0:1788813191.351432:0:9156:0:(import.c:65:import_set_state_nolock()) ffff948942c7e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788813191.351470:0:9156:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1788813191.351662:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+21:2395:x1875706301762432:12345-192.168.202.13@tcp:39:umount.0 Request processed in 1420us (10019us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788813191.351672:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 257 00000020:00010000:1.0:1788813191.353096:0:6482:0:(genops.c:1906:obd_stale_export_get()) Get export ffff948942c7e000: total 0 00010000:00010000:1.0:1788813191.353172:0:6482:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff948942c7e000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788813191.353208:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:1.0:1788813191.353212:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788813191.353223:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdac00/0xf32533d6ff702d91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296ce expref: 20 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813191.353246:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:1.0:1788813191.353249:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788813191.353253:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff703460 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298aa expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813191.353266:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948a455ee300) 00010000:00010000:1.0:1788813191.353269:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788813191.353272:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656800/0xf32533d6ff70308c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07297a7 expref: 18 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813191.353734:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:1.0:1788813191.353739:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813191.353744:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff703a6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a55 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813191.353756:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6fe40300) 00010000:00010000:1.0:1788813191.353759:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813191.353763:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08400/0xf32533d6ff702d36 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296b9 expref: 16 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813191.353779:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813191.353782:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813191.353793:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff7033aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729879 expref: 15 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813191.353807:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813191.353809:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788813191.353812:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656000/0xf32533d6ff7033d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729887 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813191.353823:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764be000) 00010000:00010000:1.0:1788813191.353825:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813191.353828:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657e00/0xf32533d6ff703444 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07298a3 expref: 13 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813191.353837:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:1.0:1788813191.353839:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788813191.353912:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff703a95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a63 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813191.354153:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff948a74a15800) 00010000:00010000:1.0:1788813191.354158:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788813191.354164:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff70374d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729983 expref: 11 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813191.354185:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff948a74b15d00) 00010000:00010000:1.0:1788813191.354188:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813191.354192:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbe00/0xf32533d6ff702d1a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07296b2 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813191.354207:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948a429cce00) 00010000:00010000:1.0:1788813191.354215:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813191.354219:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031a00/0xf32533d6ff70398b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a1d expref: 9 pid: 12571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813191.354234:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948a764be700) 00010000:00010000:1.0:1788813191.354237:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813191.354241:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a43daca00/0xf32533d6ff7032ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729841 expref: 8 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813191.354253:0:6482:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff948942c7e000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788813191.354274:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813191.354276:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813191.354715:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813191.366380:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813191.366463:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301762560 00000100:00100000:3.0:1788813191.366473:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301762560 00000100:00100000:3.0:1788813191.366535:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 258 00000100:00100000:3.0:1788813191.366547:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+5:2395:x1875706301762560:12345-192.168.202.13@tcp:39:umount.0 00000020:00000080:3.0:1788813191.366586:0:12571:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff70293f 00000100:00080000:3.0:1788813191.366604:0:12571:0:(import.c:65:import_set_state_nolock()) ffff948a61041000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788813191.366649:0:12571:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788813191.366831:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2fa4f95-78d4-4e44-8582-bb12ec2edfd4+3:2395:x1875706301762560:12345-192.168.202.13@tcp:39:umount.0 Request processed in 285us (460us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788813191.366838:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 258 00010000:00010000:2.0:1788813191.367284:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813191.524421:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313328768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813191.524491:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813191.524617:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313328768 00000100:00100000:3.0:1788813191.524627:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313328768 00000100:00100000:3.0:1788813191.524705:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788813191.524716:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313328768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788813191.524746:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788813191.524794:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313328768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813191.524817:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788813191.524869:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313328768:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788813191.525028:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813191.525080:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313328896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813191.525109:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813191.525158:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313328896 00000100:00100000:2.0:1788813191.525162:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313328896 00000100:00100000:2.0:1788813191.525203:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788813191.525211:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313328896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813191.525221:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788813191.525251:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313328896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813191.525267:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788813191.525298:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313328896:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788813191.525393:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813191.525879:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313329024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813191.525910:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813191.526198:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313329536:0@lo:400:kworker.0 00000100:00100000:0.0:1788813191.526226:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813191.526244:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313330048:0@lo:400:kworker.0 00000100:00100000:0.0:1788813191.526264:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813191.526281:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788813191.526286:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313329408:0@lo:400:kworker.0 00000100:00100000:0.0:1788813191.526319:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813191.526341:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313329920:0@lo:400:kworker.0 00000100:00100000:0.0:1788813191.526360:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813191.526384:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313330048 00000100:00100000:0.0:1788813191.526389:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313330048 00000100:00100000:0.0:1788813191.526422:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313329920 00000100:00100000:0.0:1788813191.526425:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313329920 00000100:00100000:0.0:1788813191.526444:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788813191.526451:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313330048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813191.526491:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313330048:12345-0@lo:400:kworker.0 Request processed in 41us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813191.526498:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788813191.526511:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788813191.526517:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313329920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813191.526542:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313329920:12345-0@lo:400:kworker.0 Request processed in 26us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813191.526548:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1788813191.526563:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813191.526575:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313329024 00000100:00100000:0.0:1788813191.526578:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313329024 00000100:00100000:0.0:1788813191.526598:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313329536 00000100:00100000:0.0:1788813191.526600:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313329536 00000100:00100000:0.0:1788813191.526611:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788813191.526616:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313329024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788813191.526654:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788813191.526696:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313329024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813191.526711:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788813191.526724:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788813191.526730:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313329536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813191.526759:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313329536:12345-0@lo:400:kworker.0 Request processed in 29us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813191.526765:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788813191.526782:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313329280:0@lo:400:kworker.0 00000100:00100000:0.0:1788813191.526803:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813191.526819:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313329792:0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.527001:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313329408 00000100:00100000:3.0:1788813191.527006:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313329408 00000100:00100000:3.0:1788813191.527034:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313329280 00000100:00100000:3.0:1788813191.527036:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313329280 00000100:00100000:3.0:1788813191.527055:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788813191.527061:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313329408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.527098:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313329408:12345-0@lo:400:kworker.0 Request processed in 37us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813191.527103:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788813191.527116:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788813191.527122:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313329280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.527145:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313329280:12345-0@lo:400:kworker.0 Request processed in 23us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813191.527150:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788813191.527165:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313329152:0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.527189:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813191.527211:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313329664:0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.527233:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313329152 00000100:00100000:3.0:1788813191.527236:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313329152 00000100:00100000:3.0:1788813191.527259:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788813191.527271:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313329152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.527302:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313329152:12345-0@lo:400:kworker.0 Request processed in 32us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813191.527308:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788813191.527368:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313329408:0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.527378:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313329920:0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.527386:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313329536:0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.527395:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313330048:0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.527409:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313329024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813191.527546:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813191.527579:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313330304:0@lo:400:kworker.0 00000100:00100000:0.0:1788813191.527603:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813191.527628:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313329280:0@lo:400:kworker.0 00000100:00100000:2.0:1788813191.527805:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313329792 00000100:00100000:2.0:1788813191.527810:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313329792 00000100:00100000:2.0:1788813191.527855:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313330304 00000100:00100000:2.0:1788813191.527858:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313330304 00000100:00100000:2.0:1788813191.527877:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788813191.527883:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313329792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813191.527923:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313329792:12345-0@lo:400:kworker.0 Request processed in 40us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813191.527960:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788813191.527976:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788813191.527983:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313330304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813191.528013:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313330304:12345-0@lo:400:kworker.0 Request processed in 32us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813191.528017:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00080000:2.0:1788813191.528034:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788813191.528268:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813191.528298:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313330176:0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.528322:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813191.528354:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313329152:0@lo:400:kworker.0 00000100:00100000:1.0:1788813191.528415:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313329664 00000100:00100000:1.0:1788813191.528419:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313329664 00000100:00100000:1.0:1788813191.528455:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313330176 00000100:00100000:1.0:1788813191.528458:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313330176 00000100:00100000:1.0:1788813191.528482:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788813191.528489:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313329664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813191.528524:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313329664:12345-0@lo:400:kworker.0 Request processed in 36us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813191.528530:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788813191.528544:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788813191.528550:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313330176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813191.528573:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313330176:12345-0@lo:400:kworker.0 Request processed in 24us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813191.528579:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788813191.528616:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313329664:0@lo:400:kworker.0 00000100:00100000:1.0:1788813191.528625:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313330176:0@lo:400:kworker.0 00000100:00080000:3.0:1788813191.528752:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788813191.528850:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894424f800 x1875706313329792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813191.528863:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313329792:0@lo:400:kworker.0 00010000:00080000:0.0:1788813191.528873:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894424dc00 x1875706313330304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813191.528882:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313330304:0@lo:400:kworker.0 00010000:00010000:2.0:1788813192.164715:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813193.188324:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813193.572298:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313330432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813193.572394:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813193.572626:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313330432 00000100:00100000:0.0:1788813193.572638:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313330432 00000100:00100000:0.0:1788813193.572723:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788813193.572735:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313330432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813193.572801:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813193.572857:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313330432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813193.572865:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1788813193.573000:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813193.573047:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313330432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813193.573303:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813193.573313:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313330560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813193.573352:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813193.573424:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313330560 00000100:00100000:0.0:1788813193.573429:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313330560 00000100:00100000:0.0:1788813193.573470:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788813193.573477:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313330560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788813193.573489:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788813193.573520:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313330560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813193.573527:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1788813193.573739:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813193.573779:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313330560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788813194.085259:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313330688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813194.085364:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813194.085415:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313330688 00000100:00100000:0.0:1788813194.085426:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313330688 00000100:00100000:0.0:1788813194.085492:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788813194.085503:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313330688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813194.085549:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788813194.085621:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313330688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813194.085629:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788813194.085877:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313330688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813194.160573:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813194.160626:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813194.160758:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813194.160878:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301762816 00000100:00100000:2.0:1788813194.160892:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301762816 00000100:00100000:2.0:1788813194.161016:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301762688 00000100:00100000:2.0:1788813194.161021:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301762688 00000100:00100000:2.0:1788813194.161041:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301762944 00000100:00100000:2.0:1788813194.161044:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301762944 00000100:00100000:2.0:1788813194.161066:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:2.0:1788813194.161079:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:612bc516-9aee-451d-b7c0-359fff7db073+12:2396:x1875706301762816:12345-192.168.202.13@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788813194.161081:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:1.0:1788813194.161092:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:612bc516-9aee-451d-b7c0-359fff7db073+12:2397:x1875706301762688:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813194.161100:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813194.161100:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813194.161124:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cda400/0xf32533d6ff702af8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729611 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813194.161124:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff702af1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07295e0 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813194.161144:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813194.161145:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813194.161215:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:3.0:1788813194.161224:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50682850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:612bc516-9aee-451d-b7c0-359fff7db073+10:2397:x1875706301762944:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813194.161233:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813194.161243:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e5200/0xf32533d6ff702ce9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a072969d expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813194.161271:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813194.161340:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:612bc516-9aee-451d-b7c0-359fff7db073+9:2397:x1875706301762688:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 250us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813194.161349:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:2.0:1788813194.161380:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:612bc516-9aee-451d-b7c0-359fff7db073+8:2396:x1875706301762816:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 304us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813194.161448:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50682850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:612bc516-9aee-451d-b7c0-359fff7db073+8:2397:x1875706301762944:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 226us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813194.161455:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:2.0:1788813194.161492:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:1.0:1788813194.177908:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813194.178191:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301763200 00000100:00100000:3.0:1788813194.178206:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301763200 00000100:00080000:2.0:1788813194.178282:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813194.178300:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 259 00000100:00100000:3.0:1788813194.178313:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+6:2395:x1875706301763200:12345-192.168.202.13@tcp:39:umount.0 00000020:00000080:3.0:1788813194.178371:0:6495:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702b06 00000020:00010000:3.0:1788813194.178380:0:6495:0:(genops.c:1920:obd_stale_export_put()) Put export ffff94894344b800: total 0 00000100:00080000:3.0:1788813194.178386:0:6495:0:(import.c:65:import_set_state_nolock()) ffff948943449000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788813194.178419:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:2.0:1788813194.178427:0:7900:0:(genops.c:1906:obd_stale_export_get()) Get export ffff94894344b800: total 0 00010000:00010000:2.0:1788813194.178432:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813194.178524:0:7900:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94894344b800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788813194.178725:0:7900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a764be000) 00010000:00010000:2.0:1788813194.178729:0:7900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813194.178741:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031c00/0xf32533d6ff703ab8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a71 expref: 5 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813194.178805:0:7900:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94894344b800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788813194.178821:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813194.178823:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813194.178825:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813194.179803:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:811c25ff-4ab1-402b-924d-5308c16318af+3:2395:x1875706301763200:12345-192.168.202.13@tcp:39:umount.0 Request processed in 1489us (1904us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1788813194.179815:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 259 00000100:00100000:0.0:1788813194.204383:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813194.204449:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301763328 00000100:00100000:1.0:1788813194.204463:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301763328 00000100:00080000:2.0:1788813194.204695:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788813194.204768:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 260 00000100:00100000:1.0:1788813194.204781:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+5:2395:x1875706301763328:12345-192.168.202.13@tcp:39:umount.0 00000020:00000080:1.0:1788813194.204840:0:6494:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702b0d 00000100:00080000:1.0:1788813194.204854:0:6494:0:(import.c:65:import_set_state_nolock()) ffff94894344f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788813194.204927:0:6494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1788813194.205231:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813194.205359:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:811c25ff-4ab1-402b-924d-5308c16318af+3:2395:x1875706301763328:12345-192.168.202.13@tcp:39:umount.0 Request processed in 571us (978us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788813194.205389:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 260 00010000:00010000:1.0:1788813194.212671:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813194.258455:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813194.258842:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301763584 00000100:00100000:3.0:1788813194.258859:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301763584 00000100:00100000:3.0:1788813194.258978:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 389 00000100:00100000:3.0:1788813194.258990:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6129c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+7:2395:x1875706301763584:12345-192.168.202.13@tcp:251:umount.0 00000020:00000080:3.0:1788813194.259060:0:6488:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702915 00000020:00010000:3.0:1788813194.259071:0:6488:0:(genops.c:1920:obd_stale_export_put()) Put export ffff948941921800: total 0 00000100:00080000:3.0:1788813194.259076:0:6488:0:(import.c:65:import_set_state_nolock()) ffff948941924000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788813194.259399:0:7900:0:(genops.c:1906:obd_stale_export_get()) Get export ffff948941921800: total 0 00010000:00010000:2.0:1788813194.259475:0:7900:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff948941921800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788813194.259725:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a4151d200/0xf32533d6ff702a26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a07295d2 expref: 3 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813194.259744:0:7900:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff948941921800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788813194.259759:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813194.259761:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813194.259763:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813194.259886:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6129c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:612bc516-9aee-451d-b7c0-359fff7db073+1:2395:x1875706301763584:12345-192.168.202.13@tcp:251:umount.0 Request processed in 897us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813194.259896:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 389 00000020:00000080:3.0:1788813194.259909:0:6488:0:(genops.c:885:class_export_put()) final put ffff948941921800/612bc516-9aee-451d-b7c0-359fff7db073 00000020:00000080:1.0:1788813194.260094:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948941921800/612bc516-9aee-451d-b7c0-359fff7db073 for MGS 00000020:00000080:1.0:1788813194.260147:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948941924000 for MGS 00010000:00010000:1.0:1788813195.239648:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788813195.999871:0:15173:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788813196.027817:0:15173:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788813196.027869:0:15173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.027884:0:15173:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.027908:0:15173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.027915:0:15173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.027968:0:15173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788813196.027974:0:15173:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788813196.027998:0:15173:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788813196.028002:0:15173:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788813196.028007:0:15173:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788813196.028031:0:15173:0:(import.c:65:import_set_state_nolock()) ffff948a6e9ea800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788813196.028059:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313330816:0@lo:39:umount.0 00000100:00100000:0.0:1788813196.028116:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813196.028241:0:9156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313330816 00000100:00100000:2.0:1788813196.028250:0:9156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313330816 00000100:00100000:2.0:1788813196.028557:0:9156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788813196.028567:0:9156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875706313330816:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788813196.028715:0:9156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7025e2 00000100:00080000:2.0:1788813196.028725:0:9156:0:(import.c:65:import_set_state_nolock()) ffff948a507c7000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788813196.028788:0:9156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3624:x1875706313330816:12345-0@lo:39:umount.0 Request processed in 224us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813196.028795:0:9156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:2.0:1788813196.028805:0:9156:0:(genops.c:885:class_export_put()) final put ffff948a507c7800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788813196.028829:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813196.028834:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.028855:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08600 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:2.0:1788813196.028859:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.028868:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813196.028874:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813196.028879:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788813196.028881:0:7900:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788813196.028884:0:7900:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788813196.028908:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.028914:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813196.028954:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.028961:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a6fc08600/0xf32533d6ff702ab9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.028973:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813196.028975:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813196.028976:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788813196.028985:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a507c7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788813196.029024:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a507c7000 for lustre-MDT0000 00000100:00100000:2.0:1788813196.029040:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313330944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813196.029072:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813196.029114:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313330944 00000100:00100000:2.0:1788813196.029118:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313330944 00010000:00010000:1.0:1788813196.029386:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813196.030816:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813196.030826:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3628:x1875706313330944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813196.030839:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813196.030855:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cdba00/0xf32533d6ff702ac0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff702ab9 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.030867:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813196.030916:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:3628:x1875706313330944:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813196.030923:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813196.030983:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:3628:1875706313330944:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788813196.031017:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a6e9ea800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788813196.031026:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313330816:0@lo:39:umount.0 00000100:00080000:0.0:1788813196.031570:0:15173:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788813196.031575:0:15173:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788813196.031580:0:15173:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788813196.032535:0:15173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702ace expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032549:0:15173:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702ace expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032556:0:15173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702ace expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032563:0:15173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702ace expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032595:0:15173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813196.032601:0:15173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7029d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032607:0:15173:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7029d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032612:0:15173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff7029d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032618:0:15173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff7029d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032628:0:15173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788813196.032645:0:15173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702ce2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032653:0:15173:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702ce2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032659:0:15173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702ce2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032665:0:15173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702ce2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032675:0:15173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788813196.032681:0:15173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166fa00/0xf32533d6ff702541 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702548 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032694:0:15173:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166fa00/0xf32533d6ff702541 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702548 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032700:0:15173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4166fa00/0xf32533d6ff702541 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702548 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032707:0:15173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a4166fa00/0xf32533d6ff702541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702548 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813196.032713:0:15173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788813196.032716:0:15173:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788813196.032743:0:15173:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788813196.032747:0:15173:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788813196.032751:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813196.032756:0:15173:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1788813196.032761:0:15173:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff948a6ebcb800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788813196.032766:0:15173:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff948a6fbd1000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788813196.032771:0:15173:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff948a7b526800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788813196.032776:0:15173:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff948a6fbd4800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1788813196.032783:0:15173:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff94894344b800 811c25ff-4ab1-402b-924d-5308c16318af 192.168.202.13@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788813196.032788:0:15173:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff948942c7e000 d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 192.168.202.13@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:0.0:1788813196.032793:0:15173:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff948a71418000) has exports, disconnecting them 00000020:00080000:0.0:1788813196.032797:0:15173:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff948a6ebcb800), last request at 1788813191 00000020:00000080:0.0:1788813196.032803:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7028f2 00000100:00080000:0.0:1788813196.032820:0:15173:0:(import.c:65:import_set_state_nolock()) ffff948a6ebc8800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788813196.032871:0:15173:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a6ebcb800): rc 0 00000020:00000080:0.0:1788813196.032873:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a6ebcb800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788813196.032881:0:15173:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff948a6fbd1000), last request at 1788813191 00000020:00000080:0.0:1788813196.032884:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7027be 00000100:00080000:0.0:1788813196.032889:0:15173:0:(import.c:65:import_set_state_nolock()) ffff948a6fbd6800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788813196.032895:0:15173:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a6fbd1000): rc 0 00000020:00000080:0.0:1788813196.032897:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a6fbd1000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788813196.032900:0:15173:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff948a7b526800), last request at 1788812989 00000020:00000080:0.0:1788813196.032903:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7026c9 00000100:00080000:0.0:1788813196.032905:0:15173:0:(import.c:65:import_set_state_nolock()) ffff948a7b522800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788813196.032910:0:15173:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a7b526800): rc 0 00000020:00000080:0.0:1788813196.032911:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a7b526800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788813196.032914:0:15173:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff948a6fbd4800), last request at 1788812989 00000020:00000080:0.0:1788813196.032916:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702691 00000100:00080000:0.0:1788813196.032919:0:15173:0:(import.c:65:import_set_state_nolock()) ffff948a6aec1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788813196.032924:0:15173:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:0.0:1788813196.033020:0:15173:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a6fbd4800): rc 0 00000004:00000080:0.0:1788813196.033026:0:15173:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb26501cc7ae0 00000100:00080000:0.0:1788813196.033040:0:15173:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788813196.033043:0:15173:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1788813196.033707:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788813196.033716:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702ace expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.033724:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8400 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:2.0:1788813196.033728:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702ace expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.033737:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702ace expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813196.033756:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702ace expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813196.033763:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788813196.033765:0:7900:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788813196.033768:0:7900:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788813196.033798:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702ace expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.033804:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1788813196.033818:0:15173:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00010000:00010000:2.0:1788813196.033827:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702ace expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788813196.033830:0:15173:0:(import.c:65:import_set_state_nolock()) ffff948a7b57e800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788813196.033834:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8400/0xf32533d6ff702ac7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702ace expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.033846:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788813196.033849:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff7029d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.033854:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8e00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:2.0:1788813196.033856:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff7029d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.033863:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff7029d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813196.033869:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff7029d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813196.033883:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788813196.033885:0:7900:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788813196.033887:0:7900:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788813196.033904:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff7029d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.033910:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813196.033916:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff7029d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.033922:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8e00/0xf32533d6ff7029d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff7029d9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.033950:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788813196.033954:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702ce2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.033959:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09600 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:2.0:1788813196.033962:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702ce2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.033968:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702ce2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813196.033974:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702ce2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813196.033978:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788813196.033980:0:7900:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788813196.033981:0:7900:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788813196.034000:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702ce2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.034006:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813196.034026:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702ce2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.034033:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a6fc09600/0xf32533d6ff702cdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702ce2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.034042:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813196.034046:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a4166fa00/0xf32533d6ff702541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702548 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.034051:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166fa00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:2.0:1788813196.034054:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a4166fa00/0xf32533d6ff702541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702548 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.034060:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4166fa00/0xf32533d6ff702541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702548 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813196.034066:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4166fa00/0xf32533d6ff702541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702548 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813196.034070:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788813196.034072:0:7900:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788813196.034073:0:7900:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788813196.034085:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a4166fa00/0xf32533d6ff702541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702548 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.034090:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813196.034096:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a4166fa00/0xf32533d6ff702541 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702548 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.034098:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813196.034104:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813196.034107:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4166fa00/0xf32533d6ff702541 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702548 expref: -99 pid: 6470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.034116:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813196.034117:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813196.034119:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813196.034466:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313331456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813196.034526:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813196.034571:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813196.034577:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313331584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813196.034598:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813196.036089:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313331456 00000100:00100000:3.0:1788813196.036099:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313331456 00000100:00080000:0.0:1788813196.037348:0:15173:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788813196.037355:0:15173:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1788813196.037370:0:15173:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788813196.037448:0:15173:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788813196.037469:0:15173:0:(import.c:65:import_set_state_nolock()) ffff948942016800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788813196.037479:0:15173:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788813196.037481:0:15173:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1788813196.037490:0:15173:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788813196.037555:0:15173:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788813196.037561:0:15173:0:(import.c:65:import_set_state_nolock()) ffff948a7cce2800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788813196.037587:0:15173:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff948a71418000) has no exports 00000100:00100000:3.0:1788813196.040790:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313331584 00000100:00100000:3.0:1788813196.040805:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313331584 00000100:00100000:1.0:1788813196.041064:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813196.041077:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944239180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:064264df-8ee4-4cbf-a8c5-6a62aca32881+24:3627:x1875706313331456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813196.041092:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813196.041110:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8000/0xf32533d6ff702ce2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff702cdb expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.041129:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813196.041198:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944239180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:064264df-8ee4-4cbf-a8c5-6a62aca32881+23:3627:x1875706313331456:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (6672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813196.041205:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813196.041225:0:9502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813196.041230:0:9502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:3627:x1875706313331584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813196.041238:0:9502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813196.041246:0:9502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cdb200/0xf32533d6ff702548 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff702541 expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.041256:0:9502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813196.041275:0:9502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:3627:x1875706313331584:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (6677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813196.041294:0:9502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813196.041336:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313331584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813196.041346:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:3627:1875706313331456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813196.042958:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313331328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813196.043013:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813196.043057:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813196.043063:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313331072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813196.043079:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813196.044143:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313331328 00000100:00100000:3.0:1788813196.044153:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313331328 00000100:00100000:3.0:1788813196.044192:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313331072 00000100:00100000:3.0:1788813196.044195:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313331072 00000100:00100000:3.0:1788813196.044213:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813196.044222:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+22:3626:x1875706313331328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813196.044235:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813196.044264:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc09800/0xf32533d6ff7029d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff7029d2 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813196.044681:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813196.044737:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+21:3626:x1875706313331328:12345-0@lo:103:ldlm_bl.0 Request processed in 516us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813196.044745:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813196.044766:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788813196.044773:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+20:3626:x1875706313331072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813196.044781:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813196.044790:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f9800/0xf32533d6ff702ace lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff702ac7 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813196.044800:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813196.044823:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:064264df-8ee4-4cbf-a8c5-6a62aca32881+19:3626:x1875706313331072:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813196.044829:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788813196.045819:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313331072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813196.045832:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313331328:0@lo:103:ldlm_bl.0 00000001:00100000:1.0:1788813196.046802:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788813196.046808:0:6472:0:(genops.c:885:class_export_put()) final put ffff948a6fbd4800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788813196.046821:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 811c25ff-4ab1-402b-924d-5308c16318af 00000001:00080000:1.0:1788813196.046829:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788813196.046832:0:6472:0:(genops.c:885:class_export_put()) final put ffff94894344b800/811c25ff-4ab1-402b-924d-5308c16318af 00000001:00100000:1.0:1788813196.046837:0:6472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000001:00080000:1.0:1788813196.046842:0:6472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1788813196.046848:0:6472:0:(genops.c:885:class_export_put()) final put ffff948942c7e000/d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000020:00000080:2.0:1788813196.047033:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6ebcb800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788813196.047082:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6fbd1000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788813196.047106:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b526800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788813196.047202:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6fbd4800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788813196.047225:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94894344b800/811c25ff-4ab1-402b-924d-5308c16318af for lustre-MDT0000 00000020:00000080:2.0:1788813196.047577:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c7e000/d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 for lustre-MDT0000 00000020:00000080:2.0:1788813196.047607:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6ebc8800 for lustre-MDT0000 00000020:00000080:2.0:1788813196.047612:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6fbd6800 for lustre-MDT0000 00000020:00000080:2.0:1788813196.047617:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a7b522800 for lustre-MDT0000 00000020:00000080:2.0:1788813196.047621:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6aec1800 for lustre-MDT0000 00000020:00000080:2.0:1788813196.047625:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948943449000 for lustre-MDT0000 00000020:00000080:2.0:1788813196.047628:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948942c7e800 for lustre-MDT0000 00000100:00100000:0.0:1788813196.048116:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313331200:0@lo:39:umount.0 00000100:00100000:0.0:1788813196.048182:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813196.048219:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313331712:0@lo:9:umount.0 00000100:00100000:0.0:1788813196.048242:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813196.048260:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313331840:0@lo:9:umount.0 00000100:00100000:0.0:1788813196.048278:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813196.048314:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313331712 00000100:00100000:0.0:1788813196.048322:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313331712 00000100:00100000:0.0:1788813196.048368:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313331840 00000100:00100000:0.0:1788813196.048372:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313331840 00000100:00100000:0.0:1788813196.048393:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788813196.048403:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875706313331712:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788813196.048428:0:8405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702866 00000100:00080000:0.0:1788813196.048438:0:8405:0:(import.c:65:import_set_state_nolock()) ffff948942c7a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788813196.048477:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788813196.048599:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3624:x1875706313331712:12345-0@lo:9:umount.0 Request processed in 197us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813196.048623:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788813196.048649:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788813196.048806:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313331200 00000100:00100000:1.0:1788813196.048810:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313331200 00000100:00100000:1.0:1788813196.048838:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788813196.048844:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875706313331200:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788813196.048859:0:6500:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702724 00000100:00080000:1.0:1788813196.048869:0:6500:0:(import.c:65:import_set_state_nolock()) ffff948a7b57c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788813196.048883:0:6500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788813196.049010:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3624:x1875706313331200:12345-0@lo:39:umount.0 Request processed in 166us (828us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788813196.049017:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00010000:1.0:1788813196.049038:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813196.049043:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813196.049150:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875706313331840:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788813196.049163:0:8405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702a11 00000100:00080000:0.0:1788813196.049169:0:8405:0:(import.c:65:import_set_state_nolock()) ffff948a7ccef000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788813196.049240:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788813196.049308:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3624:x1875706313331840:12345-0@lo:9:umount.0 Request processed in 160us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813196.049315:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788813196.049353:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b57e800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788813196.049360:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313331200:0@lo:39:umount.0 00000100:00080000:0.0:1788813196.049371:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948942016800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788813196.049393:0:3624:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788813196.049395:0:3624:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788813196.049398:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313331712:0@lo:9:umount.0 00000100:00080000:0.0:1788813196.049409:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7cce2800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788813196.049420:0:3624:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788813196.049421:0:3624:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788813196.049424:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313331840:0@lo:9:umount.0 00000100:00080000:2.0:1788813196.049873:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813196.049878:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788813196.050912:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788813196.063173:0:15173:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff948a71418000) has no exports 00000020:00000080:0.0:1788813196.145592:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff70259c 00000020:00000080:0.0:1788813196.145609:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a7142b000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788813196.145704:0:15173:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788813196.145851:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7142b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788813196.145875:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813196.145885:0:15173:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788813196.145889:0:15173:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff948a6434b380) has no exports 00000020:00000080:1.0:1788813196.150901:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702595 00000020:00000080:1.0:1788813196.150913:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a6e8ec800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788813196.150992:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813196.151002:0:15173:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788813196.151005:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a6e8e8000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788813196.151008:0:15173:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6e8e8000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788813196.151015:0:15173:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788813196.151366:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6e8ec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788813196.151414:0:15173:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948a6ec25240 - data ffff948a71b1abd0/ffff948a7b723800 00000020:01000000:1.0:1788813196.151551:0:15173:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948a74bef0c0 - data ffff948a7199ce58/ffff948a50e13800 00000001:00000004:1.0:1788813196.177717:0:15173:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1788813196.231891:0:15173:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788813196.231901:0:15173:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788813196.231918:0:15173:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff94894423ad80 x1875706313331200/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788813206 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813196.231976:0:15173:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788813196.237762:0:15173:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788813196.237769:0:15173:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1788813196.237787:0:15173:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788813196.237789:0:15173:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788813196.238448:0:8725:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788813196.238453:0:8725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788813196.238465:0:8725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788813196.239131:0:15173:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788813196.239135:0:15173:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1788813196.239149:0:15173:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788813196.239151:0:15173:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788813196.246710:0:10069:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788813196.246718:0:10069:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788813196.246730:0:10069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788813196.252228:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702564 00000020:00000080:3.0:1788813196.252266:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a6a897000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788813196.252304:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6a897000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788813196.257225:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702579 00000020:00000080:2.0:1788813196.257405:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a7142c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788813196.257422:0:15173:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788813196.257427:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813196.257434:0:15173:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788813196.257438:0:15173:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff948a7141cd40) has no exports 00000004:01000000:2.0:1788813196.257733:0:15173:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788813196.257741:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7029fc 00000020:00000080:2.0:1788813196.257746:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a7cced000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788813196.257751:0:15173:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788813196.257754:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813196.257762:0:15173:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788813196.257765:0:15173:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff948a7b704d40) has no exports 00000020:00000080:2.0:1788813196.257772:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7029f5 00000020:00000080:2.0:1788813196.257775:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a7cce4800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788813196.258349:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7142c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788813196.258359:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7cced000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788813196.258363:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7cce4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788813196.258414:0:15173:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788813196.258419:0:15173:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788813196.258423:0:15173:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1788813196.258428:0:15173:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788813196.258430:0:15173:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788813196.258565:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813196.258574:0:15173:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788813196.258579:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff70285f 00000020:00000080:3.0:1788813196.258650:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a7cce2800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788813196.258666:0:36:0:(genops.c:885:class_export_put()) final put ffff948a7cce0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788813196.258667:0:15173:0:(genops.c:885:class_export_put()) final put ffff948941923000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788813196.258668:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7cce0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788813196.258673:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788813196.258674:0:15173:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788813196.258678:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813196.258683:0:15173:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788813196.258685:0:15173:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff948a7b703380) has no exports 00000020:00000080:2.0:1788813196.258689:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702858 00000020:00000080:2.0:1788813196.258692:0:15173:0:(genops.c:885:class_export_put()) final put ffff948942012800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788813196.258749:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948941923000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788813196.258754:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948942012800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788813196.259740:0:15173:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788813196.259745:0:15173:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788813196.259748:0:15173:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1788813196.259753:0:15173:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788813196.259755:0:15173:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788813196.259795:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813196.259803:0:15173:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788813196.259813:0:15173:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788813196.259818:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff70271d 00000020:00000080:2.0:1788813196.259824:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a7b520000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788813196.259829:0:15173:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788813196.259834:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813196.259839:0:15173:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788813196.259842:0:15173:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff948a6edbcd40) has no exports 00000020:00000080:2.0:1788813196.259846:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702716 00000020:00000080:2.0:1788813196.259850:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a7b57e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788813196.263976:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948942016800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788813196.263993:0:8:0:(genops.c:885:class_export_put()) final put ffff948a44e11000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788813196.264010:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a44e11000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788813196.264021:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788813196.264102:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b520000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788813196.264107:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b57e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788813196.264984:0:15173:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788813196.264990:0:15173:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788813196.264994:0:15173:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1788813196.265001:0:15173:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788813196.265043:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813196.265055:0:15173:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788813196.265082:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813196.265085:0:15173:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788813196.265089:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a6a893800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788813196.265091:0:15173:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6a893800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788813196.265098:0:15173:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788813196.265176:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702580 00000020:00000080:3.0:1788813196.265182:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a7142f800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788813196.265186:0:15173:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788813196.265189:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813196.265193:0:15173:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788813196.265197:0:15173:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff948a714199c0) has no exports 00000020:00000080:3.0:1788813196.265214:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813196.265217:0:15173:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788813196.265228:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702587 00000020:00000080:3.0:1788813196.265232:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a7142a000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788813196.265239:0:15173:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a60186000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788813196.265242:0:15173:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a60186000 3 00000020:01000004:3.0:1788813196.265245:0:15173:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff948a60186000 from lustre-MDT0000 00000020:00000080:3.0:1788813196.265262:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813196.265264:0:15173:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788813196.265267:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a6a894000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788813196.265269:0:15173:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6a894000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788813196.265275:0:15173:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788813196.265301:0:15173:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788813196.265305:0:15173:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788813196.265307:0:15173:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788813196.265309:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813196.265312:0:15173:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788813196.265318:0:15173:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff948a507c5800 064264df-8ee4-4cbf-a8c5-6a62aca32881 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788813196.265323:0:15173:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff948a6adb19c0) has exports, disconnecting them 00000020:00080000:3.0:1788813196.265327:0:15173:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff948a507c5800), last request at 1788812979 00000020:00000080:3.0:1788813196.265340:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702525 00000020:00010000:3.0:1788813196.265344:0:15173:0:(genops.c:1920:obd_stale_export_put()) Put export ffff948a507c5800: total 2 00000100:00080000:3.0:1788813196.265348:0:15173:0:(import.c:65:import_set_state_nolock()) ffff948a507c6000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788813196.265357:0:15173:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a507c5800): rc 0 00000020:00080000:3.0:1788813196.265361:0:15173:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff948a6adb19c0) has no exports 00000100:00100000:3.0:1788813196.265408:0:6486:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff948a58553800:6486] 0 exiting: rc = 1 00000100:00100000:3.0:1788813196.265490:0:6488:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff948a58552e00:6488] 2 exiting: rc = 0 00000020:00010000:1.0:1788813196.269272:0:6481:0:(genops.c:1906:obd_stale_export_get()) Get export ffff948a507c5800: total 2 00010000:00010000:1.0:1788813196.269342:0:6481:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff948a507c5800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788813196.269376:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc08a00/0xf32533d6ff702a96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff702a8f expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.269395:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f9000/0xf32533d6ff702cd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff702ccd expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.269407:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f9e00/0xf32533d6ff702a42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff702a3b expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.269417:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a4151d400/0xf32533d6ff702993 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff70298c expref: 11 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.269430:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc08000/0xf32533d6ff702aa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff702a9d expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.269440:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8c00/0xf32533d6ff702a50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff702a49 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.269451:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e4200/0xf32533d6ff702cc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff702cbf expref: 8 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.269461:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a4151c200/0xf32533d6ff702a6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff702a65 expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.269471:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cda200/0xf32533d6ff702aea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff702ae3 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.269493:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a4151d800/0xf32533d6ff702621 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff70261a expref: 5 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.269505:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a4151ca00/0xf32533d6ff702a7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff702a73 expref: 4 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.269517:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a4166e800/0xf32533d6ff70262f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff702628 expref: 3 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.269528:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a821e4000/0xf32533d6ff702cb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf32533d6ff702cb1 expref: 2 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813196.269539:0:6481:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff948a507c5800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788813196.269552:0:6481:0:(genops.c:885:class_export_put()) final put ffff948a507c5800/064264df-8ee4-4cbf-a8c5-6a62aca32881 00010000:00010000:1.0:1788813196.269560:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813196.269562:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813196.269564:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788813196.269575:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a7b57e800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788813196.269582:0:8:0:(genops.c:885:class_export_put()) final put ffff948a7b57a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788813196.269585:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b57a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788813196.269590:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788813196.269644:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7142f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788813196.269648:0:8:0:(genops.c:885:class_export_put()) final put ffff948a6a895000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788813196.269650:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6a895000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788813196.269663:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788813196.269692:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7142a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788813196.269697:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a507c5800/064264df-8ee4-4cbf-a8c5-6a62aca32881 for MGS 00000020:00000080:1.0:1788813196.269725:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a507c6000 for MGS 00000100:00100000:1.0:1788813196.274283:0:6487:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff948a74a41a00:6487] 1 exiting: rc = 0 00000100:00100000:3.0:1788813196.274436:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274443:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274452:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274458:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274465:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274471:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274478:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274498:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274505:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274512:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274517:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274524:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274536:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274541:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274547:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274552:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274558:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274564:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274570:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274575:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274581:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274586:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274591:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274597:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274603:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274608:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274612:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274618:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274623:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274641:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274648:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274662:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274668:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274674:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274679:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274684:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274689:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274694:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274699:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274704:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274709:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274714:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274726:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274731:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274736:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274740:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274746:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274751:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274756:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274762:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274767:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274773:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274779:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274784:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274790:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274795:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274801:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274807:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274812:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274817:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274823:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274828:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274833:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813196.274838:0:15173:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788813196.278551:0:15173:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948942f53660 - data ffff948941c30288/ffff948a74a0f000 00000020:01000000:3.0:1788813196.278692:0:15173:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948a74bef2a0 - data ffff948a4215bd80/ffff948a507ca400 00000020:00000080:3.0:1788813196.279124:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702509 00000020:00000080:3.0:1788813196.279132:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a74aa4000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788813196.279147:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a74aa4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:3.0:1788813196.279158:0:15173:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a60186000 from MGS, refs=2 00000020:01000004:3.0:1788813196.279161:0:15173:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a60186000 2 00000020:01000004:3.0:1788813196.279164:0:15173:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff948a60186000 from MGS 00000020:00000080:3.0:1788813196.279182:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813196.279188:0:15173:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788813196.279190:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a74aa1000/MGS 00000020:00000080:3.0:1788813196.279193:0:15173:0:(genops.c:844:class_export_destroy()) destroying export ffff948a74aa1000/MGS for MGS 00000020:01000000:3.0:1788813196.279209:0:15173:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788813196.279268:0:15173:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788813196.279272:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813196.279278:0:15173:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788813196.279284:0:15173:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff948a6e9ea000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788813196.279290:0:15173:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff948a6adb3380) has exports, disconnecting them 00000020:00080000:3.0:1788813196.279294:0:15173:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff948a6e9ea000), last request at 1788812979 00000020:00000080:3.0:1788813196.279298:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7025d4 00000020:00080000:3.0:1788813196.279306:0:15173:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a6e9ea000): rc 0 00000020:00000080:3.0:1788813196.279310:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a6e9ea000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788813196.279331:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6e9ea000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788813196.305004:0:15173:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788813196.305016:0:15173:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788813196.305020:0:15173:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788813196.305029:0:15173:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788813196.305240:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813196.305249:0:15173:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788813196.305257:0:15173:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a60186000 1 00000020:00000080:1.0:1788813196.305263:0:15173:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7024fb 00000020:00000080:1.0:1788813196.305272:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a74aa0800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788813196.305277:0:15173:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788813196.305290:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813196.305294:0:15173:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788813196.305298:0:15173:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff948a6adb0000) has no exports 00000020:00000080:3.0:1788813196.314362:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6e9ea800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788813196.314379:0:36:0:(genops.c:885:class_export_put()) final put ffff948a4a56a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788813196.314383:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a4a56a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788813196.314392:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788813196.314480:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a74aa0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788813196.536548:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788813196.540651:0:15173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813196.540663:0:15173:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788813196.540670:0:15173:0:(genops.c:885:class_export_put()) final put ffff948a60186800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788813196.540674:0:15173:0:(genops.c:844:class_export_destroy()) destroying export ffff948a60186800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788813196.540683:0:15173:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788813196.540799:0:15173:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff948a60185800 00000020:02000400:2.0:1788813196.540861:0:15173:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1788813196.645095:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813196.645118:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313331968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813196.645203:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813196.645267:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313331968 00000100:00100000:2.0:1788813196.645275:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313331968 00000100:00100000:2.0:1788813196.645345:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788813196.645356:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313331968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813196.645388:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788813196.645429:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313331968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813196.645436:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1788813196.645458:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813196.645682:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813196.645694:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313332096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813196.645727:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813196.645807:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313331968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788813196.646081:0:10058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313332096 00000100:00100000:1.0:1788813196.646087:0:10058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313332096 00000100:00100000:1.0:1788813196.646131:0:10058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788813196.646137:0:10058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3625:x1875706313332096:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788813196.646144:0:10058:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788813196.646182:0:10058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3625:x1875706313332096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (453us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788813196.646188:0:10058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:02020000:3.0:1788813196.646892:0:3625:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:1.0:1788813196.648861:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313332224:0@lo:400:kworker.0 00000100:00100000:1.0:1788813196.648918:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813196.648972:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313332736:0@lo:400:kworker.0 00000100:00100000:1.0:1788813196.648995:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813196.649021:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788813196.649027:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313332352:0@lo:400:kworker.0 00000100:00100000:1.0:1788813196.649062:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813196.649079:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1875706313332864:0@lo:400:kworker.0 00000100:00100000:1.0:1788813196.649097:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813196.649136:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313332224 00000100:00100000:1.0:1788813196.649143:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313332224 00000100:00100000:1.0:1788813196.649176:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313332736 00000100:00100000:1.0:1788813196.649179:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313332736 00000100:00100000:1.0:1788813196.649188:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313332352 00000100:00100000:1.0:1788813196.649190:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313332352 00000100:00100000:1.0:1788813196.649197:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313332864 00000100:00100000:1.0:1788813196.649199:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313332864 00000100:00100000:1.0:1788813196.649223:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788813196.649353:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875706313332864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813196.649405:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875706313332864:12345-0@lo:400:kworker.0 Request processed in 55us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813196.649412:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788813196.649430:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788813196.649435:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3627:x1875706313332224:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788813196.649441:0:6496:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788813196.649466:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3627:x1875706313332224:12345-0@lo:400:kworker.0 Request processed in 30us (548us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788813196.649472:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788813196.649485:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788813196.649488:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3627:x1875706313332736:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788813196.649492:0:6496:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788813196.649513:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3627:x1875706313332736:12345-0@lo:400:kworker.0 Request processed in 24us (518us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788813196.649519:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788813196.649539:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788813196.649544:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3627:x1875706313332352:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788813196.649548:0:6496:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788813196.649572:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3627:x1875706313332352:12345-0@lo:400:kworker.0 Request processed in 27us (509us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788813196.649577:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1788813196.649615:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788813196.649620:0:3627:0:(import.c:65:import_set_state_nolock()) ffff948a7ccaf000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788813196.649624:0:3627:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788813196.649816:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788813196.650134:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313332608:0@lo:400:kworker.0 00000100:00100000:2.0:1788813196.650165:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813196.650186:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813196.650191:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313332480:0@lo:400:kworker.0 00000100:00100000:2.0:1788813196.650208:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813196.650227:0:14190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313332608 00000100:00100000:2.0:1788813196.650231:0:14190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313332608 00000100:00100000:2.0:1788813196.650265:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788813196.650273:0:14190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313332608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813196.650310:0:14190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313332608:12345-0@lo:400:kworker.0 Request processed in 39us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813196.650316:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1788813196.650344:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813196.650366:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313332608:0@lo:400:kworker.0 00000100:00100000:2.0:1788813196.650383:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313332480 00000100:00100000:2.0:1788813196.650386:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313332480 00000100:00100000:2.0:1788813196.650414:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788813196.650419:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313332480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813196.650447:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313332480:12345-0@lo:400:kworker.0 Request processed in 28us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813196.650452:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00080000:2.0:1788813196.650474:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788813196.650490:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9489433a5880 x1875706313332480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813196.650501:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313332480:0@lo:400:kworker.0 00000100:00080000:3.0:1788813196.661741:0:3625:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788813196.661749:0:3625:0:(import.c:65:import_set_state_nolock()) ffff948a6edc5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788813196.661753:0:3625:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788813196.661759:0:3625:0:(import.c:65:import_set_state_nolock()) ffff948a6edc5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813196.661764:0:3625:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 142 00000100:00080000:3.0:1788813196.661798:0:3625:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff948a6edc5800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813196.661837:0:3625:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489435b2a00 x1875706313332992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813196.662304:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313332992:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788813196.662380:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813196.664560:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313332992 00000100:00100000:3.0:1788813196.664574:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313332992 00000100:00100000:3.0:1788813196.664751:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788813196.664760:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1875706313332992:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788813196.664783:0:6499:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788813196.664863:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1875706313332992:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 102us (2482us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813196.664870:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:2.0:1788813196.672956:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a6edc5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813196.672969:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788813196.672974:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313332992:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788813196.703435:0:3627:0:(import.c:65:import_set_state_nolock()) ffff948a7ccaf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813196.703449:0:3627:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 153 00000100:00080000:1.0:1788813196.703466:0:3627:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff948a7ccaf000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813196.704681:0:3627:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948942e05f80 x1875706313333120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813196.704717:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313332352:0@lo:400:kworker.0 00010000:00080000:2.0:1788813196.704753:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9489433a6d80 x1875706313332864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813196.704765:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1875706313332864:0@lo:400:kworker.0 00000100:00080000:2.0:1788813196.704778:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788813196.704782:0:3627:0:(import.c:65:import_set_state_nolock()) ffff948a4a569000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788813196.704786:0:3627:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788813196.704801:0:3627:0:(import.c:65:import_set_state_nolock()) ffff948a4a569000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813196.704805:0:3627:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 142 00000100:00080000:2.0:1788813196.704814:0:3627:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff948a4a569000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813196.704827:0:3627:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948942e06680 x1875706313333248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813196.704838:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313332224:0@lo:400:kworker.0 00000100:00080000:2.0:1788813196.704851:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788813196.704854:0:3627:0:(import.c:65:import_set_state_nolock()) ffff948942c22800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788813196.704857:0:3627:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788813196.704859:0:3627:0:(import.c:65:import_set_state_nolock()) ffff948942c22800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813196.704862:0:3627:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 164 00000100:00080000:2.0:1788813196.704867:0:3627:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff948942c22800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813196.704877:0:3627:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948942e05c00 x1875706313333376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813196.704885:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313332736:0@lo:400:kworker.0 00000100:00100000:3.0:1788813196.705007:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313333120:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788813196.705081:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813196.705127:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875706313333248:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788813196.705148:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813196.705167:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313333376:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788813196.705187:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813196.705231:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313333120 00000100:00100000:3.0:1788813196.705238:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313333120 00000100:00100000:3.0:1788813196.705270:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313333248 00000100:00100000:3.0:1788813196.705273:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313333248 00000100:00100000:3.0:1788813196.705284:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313333376 00000100:00100000:3.0:1788813196.705287:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313333376 00000100:00100000:3.0:1788813196.705299:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788813196.705305:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313333120:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788813196.705323:0:6496:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788813196.705368:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313333120:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 62us (287us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813196.705375:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788813196.705393:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788813196.705397:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313333248:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788813196.705406:0:6496:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788813196.705428:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313333248:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 29us (279us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813196.705434:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788813196.705446:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788813196.705449:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313333376:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788813196.705457:0:6496:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788813196.705494:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313333376:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 43us (306us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813196.705499:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1788813196.705529:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7ccaf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813196.705533:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813196.705536:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313333120:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1788813196.705544:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a4a569000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813196.705546:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813196.705549:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875706313333248:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1788813196.705556:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948942c22800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813196.705558:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813196.705561:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313333376:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:1.0:1788813197.165757:0:8399:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788813197.165766:0:8399:0:(genops.c:885:class_export_put()) final put ffff948942c79000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788813197.165788:0:8399:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000020:00000080:1.0:1788813197.165790:0:8399:0:(genops.c:885:class_export_put()) final put ffff948943728000/d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000020:00000080:3.0:1788813197.165818:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c79000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788813197.165883:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948943728000/d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 for lustre-OST0000 00000020:00000080:3.0:1788813197.165902:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948942c7a000 for lustre-OST0000 00000020:00000080:3.0:1788813197.165908:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a44cc4000 for lustre-OST0000 00000001:00100000:3.0:1788813197.166928:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788813197.166960:0:9483:0:(genops.c:885:class_export_put()) final put ffff948a7cce9800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788813197.166977:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000020:00000080:3.0:1788813197.166979:0:9483:0:(genops.c:885:class_export_put()) final put ffff9489437d9000/d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000020:00000080:1.0:1788813197.167061:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7cce9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788813197.167099:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9489437d9000/d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 for lustre-OST0001 00000020:00000080:1.0:1788813197.167345:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a7ccef000 for lustre-OST0001 00000020:00000080:1.0:1788813197.167350:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9489437d8800 for lustre-OST0001 00000001:00100000:0.0:1788813197.168890:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788813197.168904:0:7425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1788813197.168910:0:7425:0:(genops.c:885:class_export_put()) final put ffff948a7b578000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788813197.169014:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 811c25ff-4ab1-402b-924d-5308c16318af 00000001:00080000:0.0:1788813197.169031:0:7425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1788813197.169033:0:7425:0:(genops.c:885:class_export_put()) final put ffff948943448800/811c25ff-4ab1-402b-924d-5308c16318af 00000020:00000080:3.0:1788813197.175420:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b578000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788813197.178313:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a7b57c800 for lustre-MDT0001 00000001:00100000:0.0:1788813197.178845:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000001:00080000:0.0:1788813197.178855:0:7425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1788813197.178860:0:7425:0:(genops.c:885:class_export_put()) final put ffff948a61044800/d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 00000020:00000080:3.0:1788813197.179010:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948943448800/811c25ff-4ab1-402b-924d-5308c16318af for lustre-MDT0001 00000020:00000080:3.0:1788813197.179044:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a61044800/d2fa4f95-78d4-4e44-8582-bb12ec2edfd4 for lustre-MDT0001 00000020:00000080:3.0:1788813197.179066:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94894344f000 for lustre-MDT0001 00000020:00000080:3.0:1788813197.179070:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a61041000 for lustre-MDT0001 00010000:00010000:1.0:1788813197.544466:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813198.575470:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813198.696433:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813198.696456:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313333504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813198.696524:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813198.696835:0:11298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313333504 00000100:00100000:1.0:1788813198.696844:0:11298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313333504 00000100:00100000:1.0:1788813198.696908:0:11298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788813198.696917:0:11298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313333504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788813198.696981:0:11298:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788813198.697024:0:11298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313333504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813198.697031:0:11298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1788813198.697120:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813198.697156:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313333504:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788813199.332636:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788813199.590521:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813200.615662:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788813200.738079:0:15374:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788813200.764295:0:15374:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788813200.764380:0:15374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.764402:0:15374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702a96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.764410:0:15374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702a96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.764420:0:15374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702a96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.764472:0:15374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788813200.764479:0:15374:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788813200.764616:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813200.764630:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702a96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.764643:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09e00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813200.764648:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702a96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.764658:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702a96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813200.764666:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702a96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813200.764672:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788813200.764674:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788813200.764678:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788813200.764725:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702a96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.764732:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813200.764771:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702a96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.764778:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff702a8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702a96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.764806:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813200.764808:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813200.764809:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813200.764920:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313333632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813200.765895:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813200.767169:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313333632 00000100:00100000:0.0:1788813200.767183:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313333632 00000100:00100000:0.0:1788813200.767250:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788813200.767259:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3626:x1875706313333632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788813200.767267:0:6479:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788813200 with bad export cookie 17520466923856340261 00000100:00080000:3.0:1788813200.770252:0:15374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788813200.770261:0:15374:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788813200.770270:0:15374:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788813200.770277:0:15374:0:(import.c:65:import_set_state_nolock()) ffff948a4a569000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788813200.770284:0:15374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788813200.770286:0:15374:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788813200.770289:0:15374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788813200.773326:0:15374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702aa4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773346:0:15374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702aa4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773354:0:15374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702aa4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773361:0:15374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702aa4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773385:0:15374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813200.773392:0:15374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702993 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773398:0:15374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702993 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773420:0:15374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702993 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773426:0:15374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702993 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773437:0:15374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788813200.773445:0:15374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702cd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773452:0:15374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702cd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773457:0:15374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702cd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773463:0:15374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702cd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773475:0:15374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788813200.773479:0:15374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5e00/0xf32533d6ff702628 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff70262f expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773485:0:15374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5e00/0xf32533d6ff702628 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff70262f expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773492:0:15374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e5e00/0xf32533d6ff702628 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff70262f expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773507:0:15374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a821e5e00/0xf32533d6ff702628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff70262f expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813200.773514:0:15374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788813200.773517:0:15374:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1788813200.773550:0:15374:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788813200.773554:0:15374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788813200.773558:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813200.773564:0:15374:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788813200.773570:0:15374:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff948943008800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788813200.773576:0:15374:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff948a6fbd3800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788813200.773581:0:15374:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff948a6edb8000) has exports, disconnecting them 00000020:00080000:3.0:1788813200.773585:0:15374:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff948943008800), last request at 1788813196 00010000:00010000:1.0:1788813200.773847:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788813200.773856:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702aa4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.773864:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4151de00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813200.773868:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702aa4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.773878:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702aa4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813200.773885:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702aa4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813200.773890:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788813200.773893:0:7900:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:1.0:1788813200.773895:0:7900:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1788813200.773944:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702aa4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.773951:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813200.773971:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702aa4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.773977:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4151de00/0xf32533d6ff702a9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702aa4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774003:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788813200.774006:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702993 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774011:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda600 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813200.774014:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702993 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774020:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702993 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813200.774040:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702993 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813200.774046:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788813200.774048:0:7900:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788813200.774051:0:7900:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788813200.774067:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702993 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774074:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813200.774081:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702993 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774086:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a44cda600/0xf32533d6ff70298c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702993 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774099:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813200.774101:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702cd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774114:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9200 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813200.774117:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702cd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774123:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702cd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813200.774129:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702cd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813200.774135:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788813200.774137:0:7900:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788813200.774139:0:7900:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788813200.774153:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702cd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774158:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813200.774175:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702cd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774182:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9200/0xf32533d6ff702ccd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff702cd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774192:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813200.774195:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a821e5e00/0xf32533d6ff702628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff70262f expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774200:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5e00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813200.774203:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a821e5e00/0xf32533d6ff702628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff70262f expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774215:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a821e5e00/0xf32533d6ff702628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff70262f expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813200.774221:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a821e5e00/0xf32533d6ff702628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff70262f expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813200.774226:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788813200.774227:0:7900:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788813200.774229:0:7900:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788813200.774243:0:7900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a821e5e00/0xf32533d6ff702628 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff70262f expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774248:0:7900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813200.774255:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a821e5e00/0xf32533d6ff702628 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff70262f expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774260:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a821e5e00/0xf32533d6ff702628 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf32533d6ff70262f expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813200.774272:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813200.774274:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813200.774276:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813200.774299:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313334016:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788813200.774308:0:15374:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702907 00000100:00080000:3.0:1788813200.774326:0:15374:0:(import.c:65:import_set_state_nolock()) ffff948943009000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788813200.774370:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788813200.774377:0:15374:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948943008800): rc 0 00000020:00000080:3.0:1788813200.774380:0:15374:0:(genops.c:885:class_export_put()) final put ffff948943008800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788813200.774390:0:15374:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff948a6fbd3800), last request at 1788813196 00000020:00000080:3.0:1788813200.774394:0:15374:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7027c5 00000100:00080000:3.0:1788813200.774400:0:15374:0:(import.c:65:import_set_state_nolock()) ffff948a6fbd0800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788813200.774407:0:15374:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a6fbd3800): rc 0 00000020:00000080:3.0:1788813200.774409:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a6fbd3800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788813200.774416:0:15374:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb26501c6fae0 00000100:00100000:1.0:1788813200.774428:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1788813200.774433:0:15374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788813200.774437:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313334144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813200.774443:0:15374:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff94894334ed80 x1875706313332096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788813212 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813200.774454:0:15374:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:1.0:1788813200.774466:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813200.774611:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313332096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813200.774656:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313334016 00000100:00100000:1.0:1788813200.774663:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313334016 00000100:00100000:1.0:1788813200.774695:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313334144 00000100:00100000:1.0:1788813200.774698:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313334144 00000100:00100000:1.0:1788813200.774716:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788813200.774722:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a50682050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3625:x1875706313334016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788813200.774729:0:6478:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788813200 with bad export cookie 17520466923856340261 00000100:00100000:1.0:1788813200.774772:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a50682050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3625:x1875706313334016:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (401us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788813200.774778:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788813200.774794:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788813200.774798:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3625:x1875706313334144:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788813200.774802:0:6478:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788813200 with bad export cookie 17520466923856340261 00000100:00100000:1.0:1788813200.774827:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3625:x1875706313334144:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (362us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788813200.774832:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:00000080:1.0:1788813200.774860:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948943008800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788813200.774902:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6fbd3800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788813200.774921:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948943009000 for lustre-MDT0001 00000020:00000080:1.0:1788813200.774926:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6fbd0800 for lustre-MDT0001 00010000:00010000:1.0:1788813200.774961:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788813200.774982:0:3625:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788813200.774985:0:3625:0:(import.c:65:import_set_state_nolock()) ffff948a74aa2000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788813200.774989:0:3625:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.113@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1788813200.775068:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788813200.781077:0:15374:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788813200.781088:0:15374:0:(import.c:65:import_set_state_nolock()) ffff948a6edc5800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1788813200.787017:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813200.805333:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3626:x1875706313333632:12345-0@lo:103:ldlm_bl.0 Request processed in 38061us (39430us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788813200.805348:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788813200.806511:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788813200.815845:0:3625:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.113@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788813200.815853:0:3625:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788813200.815887:0:3625:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489433a7480 x1875706313333632/t0(0) o103->MGC192.168.202.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788813216 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813200.815904:0:3625:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489433a5f80 x1875706313334016/t0(0) o103->MGC192.168.202.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788813216 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813200.815913:0:3625:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489433a4000 x1875706313334144/t0(0) o103->MGC192.168.202.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788813216 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788813200.815923:0:3625:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788813200.815926:0:3625:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788813200.815927:0:3625:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788813200.816149:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:064264df-8ee4-4cbf-a8c5-6a62aca32881:0:1875706313333760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813200.816404:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:064264df-8ee4-4cbf-a8c5-6a62aca32881:0:1875706313333888:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788813200.817093:0:15374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788813200.817100:0:15374:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1788813200.817122:0:15374:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788813200.817184:0:15374:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788813200.817211:0:15374:0:(import.c:65:import_set_state_nolock()) ffff948942c27800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788813200.817228:0:15374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788813200.817230:0:15374:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1788813200.817239:0:15374:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788813200.817305:0:15374:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788813200.817315:0:15374:0:(import.c:65:import_set_state_nolock()) ffff948a7ccee800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788813200.817344:0:15374:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff948a6edb8000) has no exports 00000100:00100000:3.0:1788813200.817737:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313334272:0@lo:9:umount.0 00000100:00100000:3.0:1788813200.817810:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813200.820148:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313334400:0@lo:9:umount.0 00000100:00100000:3.0:1788813200.820203:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813200.822774:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313334272 00000100:00100000:2.0:1788813200.822788:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313334272 00000100:00080000:3.0:1788813200.822836:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813200.822884:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313334400 00000100:00100000:2.0:1788813200.822888:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313334400 00000100:00100000:2.0:1788813200.822926:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788813200.822956:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875706313334272:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788813200.822992:0:8405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702812 00000100:00080000:2.0:1788813200.823004:0:8405:0:(import.c:65:import_set_state_nolock()) ffff948942c25800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788813200.823009:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788813200.823021:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875706313334400:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788813200.823037:0:8403:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7029bd 00000100:00080000:3.0:1788813200.823059:0:8403:0:(import.c:65:import_set_state_nolock()) ffff948a7b797000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788813200.823063:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000001:00000004:3.0:1788813200.823097:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788813200.823276:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3624:x1875706313334400:12345-0@lo:9:umount.0 Request processed in 257us (3071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813200.823288:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788813200.823311:0:6489:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788813200.823319:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788813200.823350:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948942c27800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788813200.823362:0:3624:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788813200.823364:0:3624:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788813200.823368:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313334272:0@lo:9:umount.0 00000100:00080000:3.0:1788813200.823381:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7ccee800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788813200.823391:0:3624:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788813200.823393:0:3624:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788813200.823396:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313334400:0@lo:9:umount.0 00000100:00100000:2.0:1788813200.823728:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3624:x1875706313334272:12345-0@lo:9:umount.0 Request processed in 331us (5473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813200.823738:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:3.0:1788813200.825013:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788813200.830623:0:3626:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff948a74aa2000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788813200.830689:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:064264df-8ee4-4cbf-a8c5-6a62aca32881:3626:1875706313333632:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788813200.833206:0:3625:0:(import.c:65:import_set_state_nolock()) ffff948a74aa2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813200.833220:0:3625:0:(import.c:545:import_select_connection()) MGC192.168.202.113@tcp: connect to NID 0@lo last attempt 132 00000100:00080000:1.0:1788813200.833236:0:3625:0:(import.c:666:import_select_connection()) MGC192.168.202.113@tcp: import ffff948a74aa2000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813200.833308:0:3625:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a6680 x1875706313334528/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788813200.834270:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313334016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813200.835529:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:064264df-8ee4-4cbf-a8c5-6a62aca32881:3624:1875706313334528:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1788813200.835607:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875706313334528 offset 0 length 520: 4 00000100:00100000:0.0:1788813200.835832:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:064264df-8ee4-4cbf-a8c5-6a62aca32881:3625:1875706313334144:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788813200.850564:0:15374:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff948a6edb8000) has no exports 00000020:01000000:0.0:1788813200.979564:0:15374:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948a6ec250c0 - data ffff948a71b1e000/ffff948a7b722c00 00000020:01000000:1.0:1788813200.980328:0:15374:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948a6fb47780 - data ffff948a719ce288/ffff948a6ea90c00 00000001:00000004:1.0:1788813200.998079:0:15374:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788813201.070057:0:15374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788813201.070067:0:15374:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788813201.070075:0:15374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788813201.076490:0:15374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788813201.076499:0:15374:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1788813201.076654:0:15374:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788813201.076658:0:15374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788813201.085525:0:8718:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788813201.085533:0:8718:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1788813201.085549:0:8718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788813201.089621:0:15374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788813201.089629:0:15374:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788813201.089650:0:15374:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788813201.089653:0:15374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788813201.091474:0:10064:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788813201.091485:0:10064:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1788813201.091501:0:10064:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788813201.093003:0:15374:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff70264b 00000020:00000080:3.0:1788813201.093015:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a6eae2000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788813201.093540:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6eae2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788813201.100357:0:15374:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702660 00000020:00000080:3.0:1788813201.100372:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a6edc1000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788813201.100392:0:15374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788813201.100398:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813201.100406:0:15374:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788813201.100409:0:15374:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff948a7141b380) has no exports 00000020:00000080:1.0:1788813201.100595:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6edc1000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1788813201.100841:0:15374:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788813201.100849:0:15374:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7029b6 00000020:00000080:3.0:1788813201.100854:0:15374:0:(genops.c:885:class_export_put()) final put ffff948942014000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788813201.100865:0:15374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788813201.100869:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813201.100876:0:15374:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788813201.100879:0:15374:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff94894207b380) has no exports 00000020:00000080:3.0:1788813201.100884:0:15374:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7029af 00000020:00000080:3.0:1788813201.100887:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a7ccee000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788813201.101013:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948942014000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788813201.101021:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7ccee000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788813201.101466:0:15374:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788813201.101471:0:15374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788813201.101475:0:15374:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788813201.101479:0:15374:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788813201.101482:0:15374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788813201.101611:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813201.101619:0:15374:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788813201.101625:0:15374:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff70280b 00000020:00000080:3.0:1788813201.101634:0:15374:0:(genops.c:885:class_export_put()) final put ffff948942c20000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788813201.109262:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a7ccee800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788813201.109294:0:36:0:(genops.c:885:class_export_put()) final put ffff948a6ebc9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788813201.109298:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6ebc9800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788813201.109307:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788813201.114435:0:15374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788813201.114564:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813201.114600:0:15374:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788813201.114605:0:15374:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff948a506e3380) has no exports 00000020:00000080:3.0:1788813201.114614:0:15374:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702804 00000020:00000080:3.0:1788813201.114623:0:15374:0:(genops.c:885:class_export_put()) final put ffff948942c22000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788813201.115019:0:15374:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788813201.115025:0:15374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788813201.115029:0:15374:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1788813201.115034:0:15374:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788813201.115037:0:15374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788813201.115070:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813201.115077:0:15374:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788813201.115091:0:15374:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788813201.115098:0:15374:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702683 00000020:00000080:3.0:1788813201.115102:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a6fbd3000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788813201.115107:0:15374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788813201.115110:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813201.115113:0:15374:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788813201.115115:0:15374:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff948a6edbb380) has no exports 00000020:00000080:3.0:1788813201.115119:0:15374:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff70267c 00000020:00000080:3.0:1788813201.115122:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a6edc3000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788813201.119675:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c20000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788813201.119697:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c22000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788813201.119705:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948942c27800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788813201.119716:0:36:0:(genops.c:885:class_export_put()) final put ffff948942011800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788813201.119719:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948942011800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788813201.119723:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788813201.119823:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6fbd3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788813201.119830:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6edc3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788813201.124069:0:15374:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788813201.124077:0:15374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788813201.124081:0:15374:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788813201.124090:0:15374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788813201.124164:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813201.124177:0:15374:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788813201.124210:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813201.124213:0:15374:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788813201.124220:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a6eae6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788813201.124225:0:15374:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6eae6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788813201.124240:0:15374:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788813201.124462:0:15374:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702667 00000020:00000080:2.0:1788813201.124470:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a6edc0800/lustre-MDD0001_UUID 00000020:01000000:2.0:1788813201.124474:0:15374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788813201.124478:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813201.124483:0:15374:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788813201.124487:0:15374:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff948a6edb99c0) has no exports 00000020:00000080:1.0:1788813201.124541:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a6edc5800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788813201.124551:0:36:0:(genops.c:885:class_export_put()) final put ffff948a6edc2000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788813201.124553:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6edc2000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788813201.124558:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788813201.124649:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6edc0800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788813201.124836:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813201.124841:0:15374:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788813201.124844:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a6a890000/lustre-MDD0001_UUID 00000020:00000080:2.0:1788813201.124847:0:15374:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6a890000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1788813201.124860:0:15374:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1788813201.125048:0:15374:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff70266e 00000020:00000080:2.0:1788813201.125054:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a6edc3800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788813201.125065:0:15374:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a61047800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788813201.125068:0:15374:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a61047800 2 00000020:01000004:2.0:1788813201.125071:0:15374:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff948a61047800 from lustre-MDT0001 00000020:00000080:2.0:1788813201.125090:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813201.125094:0:15374:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788813201.125096:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a6eae1000/lustre-MDT0001_UUID 00000020:00000080:2.0:1788813201.125098:0:15374:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6eae1000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788813201.125105:0:15374:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788813201.125127:0:15374:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788813201.125131:0:15374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788813201.125134:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813201.125138:0:15374:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788813201.125144:0:15374:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff948a7b526000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788813201.125149:0:15374:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff948a6adb4d40) has exports, disconnecting them 00000020:00080000:2.0:1788813201.125154:0:15374:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff948a7b526000), last request at 1788812989 00000020:00000080:2.0:1788813201.125158:0:15374:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7026c2 00000020:00080000:2.0:1788813201.125168:0:15374:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a7b526000): rc 0 00000020:00000080:2.0:1788813201.125172:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a7b526000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788813201.125614:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6edc3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788813201.125620:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b526000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1788813201.197328:0:15374:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1788813201.197337:0:15374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788813201.197342:0:15374:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788813201.197349:0:15374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788813201.197606:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a4a569000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788813201.197796:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813201.197817:0:15374:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788813201.197822:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a6e9ee000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788813201.197826:0:15374:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6e9ee000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788813201.197832:0:15374:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1788813201.198099:0:15374:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a61047800 1 00000020:00000080:2.0:1788813201.198106:0:15374:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7025fe 00000020:00000080:2.0:1788813201.198113:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a61045000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1788813201.198153:0:15374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1788813201.198158:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813201.198163:0:15374:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788813201.198167:0:15374:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff948a6434cd40) has no exports 00000020:00000080:1.0:1788813201.203368:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a61045000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000100:00080000:1.0:1788813201.767426:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 064264df-8ee4-4cbf-a8c5-6a62aca32881->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788813201.767436:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 064264df-8ee4-4cbf-a8c5-6a62aca32881->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813201.767439:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788813201.767444:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788813201.767448:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a7ccaf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813201.767456:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 349 00000100:00080000:1.0:1788813201.767463:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788813201.767478:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff948a7ccaf000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813201.767550:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a5f80 x1875706313334656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813201.767612:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788813201.767616:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788813201.767618:0:36:0:(import.c:65:import_set_state_nolock()) ffff948942c22800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813201.767621:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 349 00000100:00080000:1.0:1788813201.767625:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788813201.767630:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff948942c22800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813201.767642:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a4a80 x1875706313334912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813201.767796:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313334656:0@lo:38:kworker.0 00000100:00100000:2.0:1788813201.767899:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813201.767973:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313334912:0@lo:38:kworker.0 00000100:00100000:2.0:1788813201.767992:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813201.768032:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313334784:0@lo:400:kworker.0 00000100:00100000:2.0:1788813201.768055:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813201.768074:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813201.768080:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1875706313335040:0@lo:400:kworker.0 00000100:00100000:2.0:1788813201.768099:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813201.768127:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313334656 00000100:00100000:2.0:1788813201.768136:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313334656 00000100:00100000:2.0:1788813201.768167:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313334912 00000100:00100000:2.0:1788813201.768171:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313334912 00000100:00100000:2.0:1788813201.768179:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313334784 00000100:00100000:2.0:1788813201.768181:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313334784 00000100:00100000:2.0:1788813201.768192:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313335040 00000100:00100000:2.0:1788813201.768194:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313335040 00000100:00100000:2.0:1788813201.768206:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788813201.768214:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3624:x1875706313334656:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788813201.768233:0:6495:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788813201.770888:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788813201.770900:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313334912:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788813201.770923:0:6496:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788813201.771031:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313334912:12345-0@lo:38:kworker.0 Request processed in 131us (3037us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788813201.771039:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788813201.771065:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788813201.771070:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3627:x1875706313334784:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788813201.771077:0:6496:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788813201.771109:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3627:x1875706313334784:12345-0@lo:400:kworker.0 Request processed in 38us (3052us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788813201.771115:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788813201.771128:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788813201.771132:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3627:x1875706313335040:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788813201.771137:0:6496:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788813201.771176:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3627:x1875706313335040:12345-0@lo:400:kworker.0 Request processed in 42us (3076us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788813201.771182:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:1.0:1788813201.771222:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788813201.771226:0:3627:0:(import.c:65:import_set_state_nolock()) ffff948942016000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788813201.771229:0:3627:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788813201.787682:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948942c22800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813201.787697:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813201.787702:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313334912:0@lo:38:kworker.0 00000100:00100000:2.0:1788813201.798352:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3624:x1875706313334656:12345-0@lo:38:kworker.0 Request processed in 30132us (30447us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788813201.798417:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1788813201.798472:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7ccaf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813201.798477:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788813201.798482:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313334656:0@lo:38:kworker.0 00000100:00080000:1.0:1788813201.837887:0:3627:0:(import.c:65:import_set_state_nolock()) ffff948942016000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813201.837901:0:3627:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 164 00000100:00080000:1.0:1788813201.837918:0:3627:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff948942016000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813201.840090:0:3627:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a764c9500 x1875706313335168/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813201.840118:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1875706313335040:0@lo:400:kworker.0 00000100:00080000:2.0:1788813201.840148:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788813201.840153:0:3627:0:(import.c:65:import_set_state_nolock()) ffff948942010800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788813201.840157:0:3627:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788813201.840161:0:3627:0:(import.c:65:import_set_state_nolock()) ffff948942010800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813201.840164:0:3627:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 153 00000100:00080000:2.0:1788813201.840175:0:3627:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff948942010800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813201.840188:0:3627:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a764ca680 x1875706313335296/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813201.840198:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313334784:0@lo:400:kworker.0 00000100:00100000:3.0:1788813201.840471:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1875706313335168:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788813201.840591:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813201.840657:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1875706313335296:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788813201.840677:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813201.840713:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313335168 00000100:00100000:3.0:1788813201.840719:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313335168 00000100:00100000:3.0:1788813201.840749:0:12571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313335296 00000100:00100000:3.0:1788813201.840763:0:12571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313335296 00000100:00100000:3.0:1788813201.840782:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788813201.840788:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3624:x1875706313335168:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788813201.840817:0:12571:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788813201.840852:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3624:x1875706313335168:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 63us (261us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813201.840859:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788813201.840878:0:12571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788813201.840882:0:12571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3624:x1875706313335296:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788813201.840889:0:12571:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788813201.840908:0:12571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3624:x1875706313335296:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 25us (230us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813201.840912:0:12571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:3.0:1788813201.840957:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948942016000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813201.840961:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813201.840964:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1875706313335168:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1788813201.840971:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948942010800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813201.840974:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813201.840976:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1875706313335296:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1788813201.891729:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788813201.908066:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813201.908081:0:15374:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788813201.908087:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a61041800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788813201.908093:0:15374:0:(genops.c:844:class_export_destroy()) destroying export ffff948a61041800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788813201.908104:0:15374:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788813201.908224:0:15374:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff948a61047000 00000020:01000000:1.0:1788813201.908244:0:15374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788813201.908249:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813201.908254:0:15374:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788813201.908259:0:15374:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff948a643499c0) has no exports 00000100:00100000:3.0:1788813201.908417:0:9156:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff948a7b535400:9156] 3 exiting: rc = 0 00000100:00100000:3.0:1788813201.908550:0:12571:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff948a7b6f9200:12571] 4 exiting: rc = 0 00000100:00100000:0.0:1788813201.909411:0:6494:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff948a484fd200:6494] 0 exiting: rc = 1 00000100:00100000:2.0:1788813201.909717:0:6496:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff948a6108d000:6496] 2 exiting: rc = 0 00000100:00100000:2.0:1788813201.910140:0:6495:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff948a74b30a00:6495] 1 exiting: rc = 0 00000100:00100000:1.0:1788813201.910246:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910256:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910261:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910267:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910273:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910279:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910285:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910290:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910296:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910301:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910309:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910327:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910332:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910338:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910344:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910349:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910354:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910359:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910365:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910369:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910375:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910380:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910385:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910390:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910395:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910400:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910406:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910411:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910417:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910422:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910427:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910432:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910438:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910444:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910449:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910455:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910460:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910465:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910470:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910475:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910480:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910486:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910491:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910496:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910514:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910520:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910533:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910610:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910619:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910625:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910630:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910636:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910642:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910728:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910735:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910740:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910746:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910751:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910757:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910763:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910770:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910776:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910782:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.910788:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.920960:0:6498:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff948a6108ce00:6498] 1 exiting: rc = 0 00000100:00100000:2.0:1788813201.928778:0:6497:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff948a510fd600:6497] 0 exiting: rc = 1 00000100:00100000:1.0:1788813201.929004:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929016:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929022:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929029:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929034:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929039:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929045:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929051:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929057:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929063:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929068:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929073:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929079:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929083:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929089:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929094:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929114:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929120:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929125:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929130:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929135:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929140:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929145:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929150:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929156:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929160:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929169:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929174:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929180:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929186:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929191:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929197:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929202:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929207:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929212:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929218:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929223:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929229:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929234:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929240:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929245:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929250:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929255:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929260:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929265:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929270:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929274:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929279:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929284:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929289:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929294:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929308:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929312:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929317:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929323:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929328:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929333:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929338:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929344:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929349:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929354:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929361:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929367:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.929372:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.929945:0:6500:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff948a6108c000:6500] 1 exiting: rc = 0 00000100:00100000:3.0:1788813201.930024:0:6499:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff948a6108da00:6499] 0 exiting: rc = 1 00000100:00100000:0.0:1788813201.931065:0:10058:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff94894232a400:10058] 2 exiting: rc = 0 00000100:00100000:1.0:1788813201.931194:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931204:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931211:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931216:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931223:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931229:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931235:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931242:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931247:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931268:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931276:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931281:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931286:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931292:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931297:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931303:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931308:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931315:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931320:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931326:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931331:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931349:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931365:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931371:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931376:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931382:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931388:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931393:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931399:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931405:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931410:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931416:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931422:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931443:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931449:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931456:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931462:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931468:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931475:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931481:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931491:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931497:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931502:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931508:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931515:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931551:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931560:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931567:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931588:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931595:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931601:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931607:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931613:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931619:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931625:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931632:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931638:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931780:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931788:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931794:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931800:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931880:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931888:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.931894:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956047:0:6501:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff948a6108d600:6501] 0 exiting: rc = 1 00000100:00100000:0.0:1788813201.956143:0:6502:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff948a642bc800:6502] 1 exiting: rc = 0 00000100:00100000:0.0:1788813201.956197:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956204:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956209:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956227:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956232:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956237:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956243:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956248:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956253:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956258:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956263:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956268:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956272:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956277:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956282:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956287:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956293:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956298:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956303:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956308:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956312:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956317:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956322:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956327:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956332:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956337:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956342:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956347:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956352:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956356:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956361:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956366:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956371:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956377:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956383:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956388:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956393:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956398:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956410:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956415:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956420:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956425:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956430:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956435:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956440:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956445:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956450:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956456:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956461:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956466:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956471:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956477:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956482:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956488:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956493:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956498:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956519:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956523:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956529:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956534:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956882:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956890:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956897:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.956902:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.958114:0:6503:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff948a642bdc00:6503] 0 exiting: rc = 1 00000100:00100000:0.0:1788813201.959078:0:6504:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff948a642bd200:6504] 1 exiting: rc = 0 00000100:00100000:1.0:1788813201.959392:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959400:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959404:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959409:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959414:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959418:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959423:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959428:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959433:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959438:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959443:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959448:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959453:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959458:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959462:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959468:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959473:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959478:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959483:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959487:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959491:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959496:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959513:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959518:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959522:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959527:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959532:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959537:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959634:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959639:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959703:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959711:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959716:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959721:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959727:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959732:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959737:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959743:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959748:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959753:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959759:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959764:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959769:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959774:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959779:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959784:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959790:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959794:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959799:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959804:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959809:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959814:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959819:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959824:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959828:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959833:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959838:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959843:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959848:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959853:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959857:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959862:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959867:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.959881:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.966875:0:6505:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff948a642bca00:6505] 0 exiting: rc = 1 00000100:00100000:3.0:1788813201.968146:0:6506:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff948a642bd000:6506] 1 exiting: rc = 0 00000100:00100000:1.0:1788813201.968277:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968285:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968291:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968295:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968300:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968304:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968310:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968314:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968319:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968325:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968330:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968335:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968340:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968345:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968351:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968356:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968362:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968366:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968372:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968376:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968381:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968386:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968390:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968395:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968400:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968406:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968412:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968417:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968421:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968426:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968431:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968436:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968442:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968447:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968460:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968465:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968470:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968474:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968480:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968485:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968489:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968494:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968511:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968517:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968523:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968528:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968533:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968546:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968552:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968557:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968562:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968567:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968572:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968587:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968593:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968599:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968604:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968609:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968614:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968620:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968625:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968630:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968635:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.968640:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.969299:0:6507:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff948a642bd400:6507] 0 exiting: rc = 1 00000100:00100000:2.0:1788813201.970133:0:6508:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff948a642bd600:6508] 1 exiting: rc = 0 00000100:00100000:2.0:1788813201.978257:0:6509:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff948a642bde00:6509] 2 exiting: rc = 0 00000100:00100000:1.0:1788813201.978492:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978502:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978507:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978514:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978520:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978539:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978545:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978551:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978556:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978561:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978566:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978571:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978591:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978595:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978601:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978606:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978612:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978618:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978622:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978627:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978632:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978637:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978643:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978648:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978667:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978674:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978678:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978683:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978689:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978694:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978699:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978704:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978710:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978717:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978722:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978727:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978733:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978738:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978744:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978749:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978764:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978769:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978774:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978779:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978785:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978791:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978796:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978802:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978823:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978830:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978836:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978841:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978846:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978851:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978857:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978863:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978869:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978874:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978879:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978884:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978889:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978894:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978899:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813201.978904:0:15374:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788813201.983158:0:15374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813201.983172:0:15374:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788813201.983178:0:15374:0:(genops.c:885:class_export_put()) final put ffff948a61071000/MDS_uuid 00000020:00000080:1.0:1788813201.983182:0:15374:0:(genops.c:844:class_export_destroy()) destroying export ffff948a61071000/MDS_uuid for MDS 00000020:01000000:1.0:1788813201.983191:0:15374:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788813201.983344:0:15374:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788813202.917292:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813203.940253:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813204.964190:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788813205.803057:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 064264df-8ee4-4cbf-a8c5-6a62aca32881->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788813205.803070:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 064264df-8ee4-4cbf-a8c5-6a62aca32881->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813205.803074:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788813205.803105:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788813205.803110:0:8:0:(import.c:65:import_set_state_nolock()) ffff948a7ccaf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813205.803122:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 354 00000100:00080000:1.0:1788813205.803130:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788813205.803147:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff948a7ccaf000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813205.803213:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a6300 x1875706313335424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813205.803245:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788813205.803249:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788813205.803251:0:8:0:(import.c:65:import_set_state_nolock()) ffff948942010800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813205.803255:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 354 00000100:00080000:1.0:1788813205.803258:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788813205.803264:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff948942010800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813205.803278:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a7b80 x1875706313335552/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813205.803288:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788813205.803292:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788813205.803294:0:8:0:(import.c:65:import_set_state_nolock()) ffff948942c22800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813205.803297:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 354 00000100:00080000:1.0:1788813205.803300:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788813205.803305:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff948942c22800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813205.803317:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a5500 x1875706313335680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813205.803325:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788813205.803333:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788813205.803335:0:8:0:(import.c:65:import_set_state_nolock()) ffff948942016000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813205.803339:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 354 00000100:00080000:1.0:1788813205.803341:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788813205.803346:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff948942016000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813205.803359:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a7100 x1875706313335808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788813205.803478:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313335424:0@lo:38:kworker.0 00000400:00000100:3.0:1788813205.803569:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313335424 offset 0 length 520: 4 00000100:00100000:3.0:1788813205.803633:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1875706313335552:0@lo:38:kworker.0 00000400:00000100:3.0:1788813205.803651:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313335552 offset 0 length 520: 4 00000100:00100000:3.0:1788813205.803667:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313335680:0@lo:38:kworker.0 00000400:00000100:3.0:1788813205.803698:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313335680 offset 0 length 520: 4 00000100:00100000:3.0:1788813205.803714:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1875706313335808:0@lo:38:kworker.0 00000400:00000100:3.0:1788813205.803727:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706313335808 offset 0 length 520: 4 00010000:00010000:0.0:1788813205.990562:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788813206.895260:0:8399:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788813206.895270:0:8399:0:(genops.c:885:class_export_put()) final put ffff948942c23000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788813206.895960:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c23000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788813206.896012:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948942c25800 for lustre-OST0000 00000001:00100000:0.0:1788813206.899233:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788813206.899243:0:9483:0:(genops.c:885:class_export_put()) final put ffff948a7b791800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788813206.902035:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b791800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788813206.902116:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a7b797000 for lustre-OST0001 00000020:01000004:2.0:1788813206.952770:0:15576:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788813206.992025:0:15576:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788813206.992084:0:15576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813206.992112:0:15576:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702a6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813206.992120:0:15576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702a6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813206.992127:0:15576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702a6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813206.992140:0:15576:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788813206.992146:0:15576:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788813206.992174:0:15576:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788813206.992186:0:15576:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489433a6300 x1875706313335424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813225 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813206.992203:0:15576:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788813206.992209:0:15576:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788813206.992215:0:15576:0:(import.c:65:import_set_state_nolock()) ffff948a7ccaf000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788813206.992220:0:15576:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788813206.992223:0:15576:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489433a6300 x1875706313335424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813225 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813206.992229:0:15576:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788813206.992233:0:15576:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:3.0:1788813206.992441:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313335424:0@lo:38:kworker.0 00010000:00010000:2.0:1788813206.992633:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813206.992640:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702a6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813206.992648:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08c00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:2.0:1788813206.992651:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702a6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813206.992659:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702a6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813206.992666:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702a6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813206.992670:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788813206.992673:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788813206.992675:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788813206.992688:0:6481:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a74aa2000 00010000:00010000:2.0:1788813206.992692:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff702a6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813206.992699:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a6fc08c00/0xf32533d6ff702a65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff702a6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813206.992712:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813206.992714:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813206.992715:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788813206.994195:0:15576:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788813206.994210:0:15576:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489433a7b80 x1875706313335552/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813220 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813206.994237:0:15576:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788813206.994243:0:15576:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788813206.994261:0:15576:0:(import.c:65:import_set_state_nolock()) ffff948942010800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788813206.994266:0:15576:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788813206.994270:0:15576:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489433a7b80 x1875706313335552/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813220 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813206.994278:0:15576:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788813206.994282:0:15576:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:3.0:1788813206.994469:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1875706313335552:0@lo:38:kworker.0 00010000:00010000:0.0:1788813206.996660:0:15576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a7a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813206.996746:0:15576:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702a7a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813206.996755:0:15576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702a7a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813206.996764:0:15576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702a7a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813206.997610:0:15576:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813206.997623:0:15576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702cc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813206.997632:0:15576:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702cc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813206.997639:0:15576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702cc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813206.997646:0:15576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702cc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813206.998056:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813206.998064:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702a7a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813206.998072:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda800 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813206.998077:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702a7a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813206.998087:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702a7a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813206.998094:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702a7a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813206.998100:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788813206.998103:0:7900:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788813206.998115:0:7900:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a74aa2000 00010000:00010000:1.0:1788813206.998118:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff702a7a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813206.998135:0:7900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a44cda800/0xf32533d6ff702a73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff702a7a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813206.998148:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813206.998151:0:7900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702cc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813206.998157:0:7900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4e00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813206.998160:0:7900:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702cc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813206.998166:0:7900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702cc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813206.998172:0:7900:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702cc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813206.998176:0:7900:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788813206.998178:0:7900:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788813206.998183:0:7900:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a74aa2000 00010000:00010000:1.0:1788813206.998186:0:7900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff702cc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813206.998193:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813206.998194:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813206.998196:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813206.998475:0:15576:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788813206.998481:0:15576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a821e4e00/0xf32533d6ff702cbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff702cc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813206.998492:0:15576:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788813206.998498:0:15576:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788813206.998500:0:15576:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788813206.998545:0:15576:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788813206.998549:0:15576:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788813206.998556:0:15576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813206.998571:0:15576:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788813206.998576:0:15576:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff948a506e0000) has no exports 00000020:00080000:0.0:1788813206.998603:0:15576:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff948a506e0000) has no exports 00000020:01000000:0.0:1788813207.001757:0:15576:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948942f53e40 - data ffff948941c30510/ffff948a74a0c800 00010000:00010000:3.0:1788813207.002101:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788813207.002244:0:15576:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948941bf6240 - data ffff948a71a7d948/ffff948a6fe24c00 00010000:00010000:2.0:1788813207.014290:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788813207.020738:0:15576:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788813207.030618:0:15576:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff70277f 00000020:00000080:1.0:1788813207.030632:0:15576:0:(genops.c:885:class_export_put()) final put ffff948a507ec800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788813207.030843:0:15576:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a7b74e800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788813207.030857:0:15576:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7b74e800 2 00000020:01000004:1.0:1788813207.030861:0:15576:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff948a7b74e800 from lustre-OST0000 00000020:00000080:1.0:1788813207.030887:0:15576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813207.030897:0:15576:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788813207.030900:0:15576:0:(genops.c:885:class_export_put()) final put ffff948a6e9e9800/lustre-OST0000_UUID 00000020:00000080:1.0:1788813207.030903:0:15576:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6e9e9800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788813207.030909:0:15576:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788813207.030988:0:15576:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788813207.030993:0:15576:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788813207.030996:0:15576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813207.031001:0:15576:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788813207.031008:0:15576:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff948a7cca9800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788813207.031014:0:15576:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9489420799c0) has exports, disconnecting them 00000020:00080000:1.0:1788813207.031019:0:15576:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff948a7cca9800), last request at 1788813000 00000020:00000080:1.0:1788813207.031022:0:15576:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7027a9 00000020:00080000:1.0:1788813207.031033:0:15576:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a7cca9800): rc 0 00000020:00000080:1.0:1788813207.031037:0:15576:0:(genops.c:885:class_export_put()) final put ffff948a7cca9800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788813207.031158:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a507ec800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788813207.033436:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7cca9800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788813207.035066:0:15576:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788813207.035073:0:15576:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788813207.035077:0:15576:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788813207.035085:0:15576:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788813207.035166:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a7ccaf000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788813207.035271:0:15576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813207.035280:0:15576:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788813207.035285:0:15576:0:(genops.c:885:class_export_put()) final put ffff948a7ccab800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788813207.035288:0:15576:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7ccab800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788813207.035300:0:15576:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788813207.035556:0:15576:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788813207.035569:0:15576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813207.035575:0:15576:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788813207.035582:0:15576:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff948942013800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788813207.035588:0:15576:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff948a506e19c0) has exports, disconnecting them 00000020:00080000:2.0:1788813207.035593:0:15576:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff948942013800), last request at 1788813000 00000020:00000080:2.0:1788813207.035597:0:15576:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7027b7 00000020:00080000:2.0:1788813207.035612:0:15576:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948942013800): rc 0 00000020:00000080:2.0:1788813207.035616:0:15576:0:(genops.c:885:class_export_put()) final put ffff948942013800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788813207.035718:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948942013800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788813207.039054:0:15576:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788813207.039062:0:15576:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788813207.039066:0:15576:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788813207.039074:0:15576:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788813207.039110:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948942010800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788813207.039320:0:15576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813207.039344:0:15576:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788813207.039349:0:15576:0:(genops.c:885:class_export_put()) final put ffff948942017000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788813207.039353:0:15576:0:(genops.c:844:class_export_destroy()) destroying export ffff948942017000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788813207.039359:0:15576:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788813207.039434:0:15576:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7b74e800 1 00000020:00000080:3.0:1788813207.039440:0:15576:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702747 00000020:00000080:3.0:1788813207.039447:0:15576:0:(genops.c:885:class_export_put()) final put ffff948a7b749000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788813207.039458:0:15576:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788813207.039465:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b749000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788813207.039481:0:15576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813207.039489:0:15576:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788813207.039501:0:15576:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff948a7653b380) has no exports 00000020:00000080:2.0:1788813207.105288:0:15576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813207.105301:0:15576:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788813207.105306:0:15576:0:(genops.c:885:class_export_put()) final put ffff948a7b748800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788813207.105310:0:15576:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b748800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788813207.106001:0:15576:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788813207.106542:0:15576:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff948a7b74b800 00000020:02000400:2.0:1788813207.106659:0:15576:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788813208.037833:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813209.060231:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813210.085062:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813210.917110:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813200/real 1788813200] req@ffff9489433a6680 x1875706313334528/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788813210 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813210.917142:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9489433a6680 x1875706313334528/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788813210 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788813210.917162:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a74aa2000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788813210.917180:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788813210.917185:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:064264df-8ee4-4cbf-a8c5-6a62aca32881:3624:1875706313334528:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1788813210.917599:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 064264df-8ee4-4cbf-a8c5-6a62aca32881->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788813210.917606:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788813210.917609:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a74aa2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813210.917615:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.113@tcp: connect to NID 0@lo last attempt 353 00000100:00080000:1.0:1788813210.917621:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.113@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788813210.917635:0:36:0:(import.c:666:import_select_connection()) MGC192.168.202.113@tcp: import ffff948a74aa2000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813210.917678:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a7800 x1875706313335936/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813210.917709:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788813210.917714:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813210.917728:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788813210.917732:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788813210.917970:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:064264df-8ee4-4cbf-a8c5-6a62aca32881:3624:1875706313335936:0@lo:250:kworker.0 00000400:00000100:2.0:1788813210.918022:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875706313335936 offset 0 length 520: 4 00010000:00010000:2.0:1788813211.109156:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788813211.185409:0:15777:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788813211.207084:0:15777:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788813211.207167:0:15777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a42 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813211.207182:0:15777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702a42 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813211.207259:0:15777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702a42 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813211.207267:0:15777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702a42 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813211.207287:0:15777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788813211.207292:0:15777:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788813211.207318:0:15777:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788813211.207329:0:15777:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489433a5500 x1875706313335680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813225 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813211.207404:0:15777:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788813211.207410:0:15777:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788813211.207416:0:15777:0:(import.c:65:import_set_state_nolock()) ffff948942c22800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788813211.207420:0:15777:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788813211.207424:0:15777:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489433a5500 x1875706313335680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813225 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788813211.207475:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813211.207483:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702a42 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813211.207511:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09a00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813211.207514:0:6482:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702a42 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813211.207521:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702a42 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813211.207527:0:6482:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702a42 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813211.207532:0:6482:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788813211.207534:0:6482:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788813211.207536:0:6482:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788813211.207548:0:6482:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a74aa2000 00010000:00010000:0.0:1788813211.207552:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff702a42 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813211.207558:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a6fc09a00/0xf32533d6ff702a3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff702a42 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813211.207567:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813211.207569:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813211.207571:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813211.207834:0:15777:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788813211.207856:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313335680:0@lo:38:kworker.0 00000100:00100000:3.0:1788813211.208073:0:15777:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788813211.211351:0:15777:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788813211.211368:0:15777:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489433a7100 x1875706313335808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813220 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813211.211439:0:15777:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788813211.211447:0:15777:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788813211.211462:0:15777:0:(import.c:65:import_set_state_nolock()) ffff948942016000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788813211.211468:0:15777:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788813211.211472:0:15777:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489433a7100 x1875706313335808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813220 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813211.211602:0:15777:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788813211.211626:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1875706313335808:0@lo:38:kworker.0 00000100:00100000:3.0:1788813211.211675:0:15777:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788813211.217632:0:15777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702a50 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813211.217653:0:15777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702a50 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813211.217661:0:15777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702a50 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813211.217685:0:15777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702a50 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813211.217714:0:15777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813211.217789:0:15777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff702cb8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813211.217797:0:15777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff702cb8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813211.217804:0:15777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702cb8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813211.217810:0:15777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf32533d6ff702cb8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813211.217822:0:15777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788813211.217825:0:15777:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788813211.217852:0:15777:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788813211.217856:0:15777:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788813211.217860:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813211.217866:0:15777:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788813211.217927:0:15777:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff948942dc8000) has no exports 00000020:00080000:3.0:1788813211.217975:0:15777:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff948942dc8000) has no exports 00010000:00010000:0.0:1788813211.218299:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813211.218307:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702a50 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813211.218315:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9600 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813211.218319:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702a50 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813211.218334:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702a50 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813211.218341:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702a50 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813211.218347:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788813211.218350:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788813211.218352:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788813211.218368:0:6481:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a74aa2000 00010000:00010000:0.0:1788813211.218374:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff702a50 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813211.218381:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9600/0xf32533d6ff702a49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff702a50 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813211.218395:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813211.218398:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702cb8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813211.218403:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656400 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:0.0:1788813211.218405:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf32533d6ff702cb8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813211.218411:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702cb8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813211.218416:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702cb8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813211.218430:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788813211.218432:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788813211.218434:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788813211.218439:0:6481:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a74aa2000 00010000:00010000:0.0:1788813211.218442:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff702cb8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813211.218448:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948943656400/0xf32533d6ff702cb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff702cb8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813211.218471:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813211.218473:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813211.218475:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813211.219298:0:7900:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788813211.221378:0:15777:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948943268f00 - data ffff948a71b20288/ffff9489432e8c00 00000020:01000000:3.0:1788813211.221608:0:15777:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948942f53240 - data ffff948941c315e8/ffff948a74a0cc00 00100000:10000000:3.0:1788813211.235711:0:15777:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788813211.242389:0:15777:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7028c1 00000020:00000080:3.0:1788813211.242410:0:15777:0:(genops.c:885:class_export_put()) final put ffff948a6eae6000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788813211.242422:0:15777:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a7b522000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788813211.242425:0:15777:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7b522000 2 00000020:01000004:3.0:1788813211.242428:0:15777:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff948a7b522000 from lustre-OST0001 00000020:00000080:3.0:1788813211.242468:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813211.242477:0:15777:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788813211.242481:0:15777:0:(genops.c:885:class_export_put()) final put ffff948a6eab7000/lustre-OST0001_UUID 00000020:00000080:3.0:1788813211.242484:0:15777:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6eab7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788813211.242500:0:15777:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788813211.242608:0:15777:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 064264df-8ee4-4cbf-a8c5-6a62aca32881->MGS 00010000:00010000:3.0:1788813211.242625:0:15777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a821e5600/0xf32533d6ff70261a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702621 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813211.242637:0:15777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a821e5600/0xf32533d6ff70261a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702621 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813211.242643:0:15777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788813211.242646:0:15777:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788813211.242649:0:15777:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788813211.242662:0:15777:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a74aa2000 00010000:00010000:3.0:1788813211.242666:0:15777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a821e5600/0xf32533d6ff70261a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff702621 expref: -99 pid: 7423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813211.242681:0:15777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff702ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf32533d6ff702aea expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813211.242688:0:15777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff702ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf32533d6ff702aea expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813211.242693:0:15777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788813211.242695:0:15777:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788813211.242697:0:15777:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788813211.242726:0:15777:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948a74aa2000 00010000:00010000:3.0:1788813211.242729:0:15777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a4151ce00/0xf32533d6ff702ae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf32533d6ff702aea expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788813211.242748:0:15777:0:(import.c:65:import_set_state_nolock()) ffff948a74aa2000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788813211.242752:0:15777:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788813211.242754:0:15777:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788813211.242756:0:15777:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788813211.242760:0:15777:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788813211.242771:0:15777:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9489433a7800 x1875706313335936/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788813225 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788813211.242793:0:15777:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788813211.242795:0:15777:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:0.0:1788813211.243175:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:064264df-8ee4-4cbf-a8c5-6a62aca32881:3624:1875706313335936:0@lo:250:kworker.0 10000000:01000000:3.0:1788813211.243243:0:15777:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788813211.243251:0:15777:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702517 00000020:00000080:3.0:1788813211.243256:0:15777:0:(genops.c:885:class_export_put()) final put ffff948a61077000/064264df-8ee4-4cbf-a8c5-6a62aca32881 00000020:01000000:3.0:1788813211.243262:0:15777:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.113@tcp (flags='') 00000020:00000080:3.0:1788813211.243266:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813211.243271:0:15777:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.113@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788813211.243275:0:15777:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff948a506e4d40) has no exports 10000000:01000000:0.0:1788813211.243331:0:6492:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788813211.243398:0:15777:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.113@tcp: client import never connected 00000100:00080000:3.0:1788813211.243401:0:15777:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788813211.243403:0:15777:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788813211.243404:0:15777:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788813211.243406:0:15777:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788813211.243433:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813211.243447:0:15777:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.113@tcp (uuid 064264df-8ee4-4cbf-a8c5-6a62aca32881) 00000020:01000000:3.0:1788813211.243461:0:15777:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788813211.243464:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813211.243468:0:15777:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788813211.243473:0:15777:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff948a6e9eb800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788813211.243477:0:15777:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff948a76538000) has exports, disconnecting them 00000020:00080000:3.0:1788813211.243498:0:15777:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff948a6e9eb800), last request at 1788813011 00000020:00000080:3.0:1788813211.243503:0:15777:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff7028eb 00000020:00080000:3.0:1788813211.243513:0:15777:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948a6e9eb800): rc 0 00000020:00000080:3.0:1788813211.243517:0:15777:0:(genops.c:885:class_export_put()) final put ffff948a6e9eb800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788813211.245077:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6eae6000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788813211.245096:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a61077000/064264df-8ee4-4cbf-a8c5-6a62aca32881 for MGC192.168.202.113@tcp 00000020:00000080:1.0:1788813211.245101:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948a74aa2000 for MGC192.168.202.113@tcp 00000020:00000080:1.0:1788813211.245109:0:37:0:(genops.c:885:class_export_put()) final put ffff948a44e16800/064264df-8ee4-4cbf-a8c5-6a62aca32881 00000020:00000080:1.0:1788813211.245112:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a44e16800/064264df-8ee4-4cbf-a8c5-6a62aca32881 for MGC192.168.202.113@tcp 00000020:01000000:1.0:1788813211.245117:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.113@tcp (064264df-8ee4-4cbf-a8c5-6a62aca32881) 00000020:00000080:1.0:1788813211.245409:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6e9eb800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788813211.254018:0:15777:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788813211.254028:0:15777:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788813211.254032:0:15777:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788813211.254040:0:15777:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788813211.254240:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788813211.254249:0:15777:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788813211.254255:0:15777:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788813211.254260:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813211.254265:0:15777:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788813211.254272:0:15777:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff948942c24800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788813211.254280:0:15777:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff948a765399c0) has exports, disconnecting them 00000020:00080000:0.0:1788813211.254285:0:15777:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff948942c24800), last request at 1788813011 00000020:00000080:0.0:1788813211.254289:0:15777:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702900 00000020:00080000:0.0:1788813211.254316:0:15777:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff948942c24800): rc 0 00000020:00000080:0.0:1788813211.254322:0:15777:0:(genops.c:885:class_export_put()) final put ffff948942c24800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788813211.255037:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948942c22800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788813211.255046:0:37:0:(genops.c:885:class_export_put()) final put ffff948941925000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788813211.255049:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948941925000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788813211.255055:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788813211.255119:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c24800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788813211.255988:0:15777:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788813211.255995:0:15777:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788813211.255999:0:15777:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788813211.256006:0:15777:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788813211.256031:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff948942016000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788813211.257980:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788813211.260011:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788813211.260245:0:7900:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788813211.260503:0:6477:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff948a63839a00:6477] 1 exiting: rc = 0 00000100:00100000:1.0:1788813211.260667:0:10309:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff948943041200:10309] 2 exiting: rc = 0 00000100:00100000:1.0:1788813211.260746:0:6476:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff948a63838400:6476] 0 exiting: rc = 1 00000100:00100000:3.0:1788813211.260905:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813211.261254:0:6524:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff948a6e900c00:6524] 3 exiting: rc = 0 00000100:00100000:1.0:1788813211.261330:0:6480:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff948a61012c00:6480] 2 exiting: rc = 0 00000100:00100000:1.0:1788813211.261392:0:9502:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9489431a5200:9502] 4 exiting: rc = 0 00000100:00100000:2.0:1788813211.261856:0:6478:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff948a61012e00:6478] 0 exiting: rc = 1 00000100:00100000:1.0:1788813211.262037:0:6479:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff948a64232c00:6479] 1 exiting: rc = 0 00000100:00100000:3.0:1788813211.262139:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262148:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262154:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262161:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262166:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262172:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262177:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262183:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262200:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262206:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262212:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262218:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262224:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262230:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262235:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262241:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262247:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262253:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262260:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262267:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262273:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262279:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262284:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262289:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262294:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262299:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262303:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262307:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262323:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262327:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262331:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262336:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262341:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262346:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262350:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262355:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262360:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262364:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262369:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262374:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262379:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262385:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262390:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262395:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262400:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262404:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262408:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262413:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262417:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262423:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262428:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262433:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262438:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262443:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262448:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262466:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262471:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262476:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262480:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262486:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262500:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262505:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262510:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.262522:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788813211.263664:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813211.263674:0:15777:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788813211.263680:0:15777:0:(genops.c:885:class_export_put()) final put ffff948942c26000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788813211.263684:0:15777:0:(genops.c:844:class_export_destroy()) destroying export ffff948942c26000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788813211.263694:0:15777:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788813211.263818:0:15777:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7b522000 1 00000020:00000080:3.0:1788813211.263825:0:15777:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf32533d6ff702890 00000020:00000080:3.0:1788813211.263833:0:15777:0:(genops.c:885:class_export_put()) final put ffff948941921000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788813211.263993:0:15777:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788813211.263998:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813211.264003:0:15777:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788813211.264008:0:15777:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff948a64348000) has no exports 00000020:00000080:1.0:1788813211.266567:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff948941921000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788813211.292496:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813211.292511:0:15777:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788813211.292517:0:15777:0:(genops.c:885:class_export_put()) final put ffff948a6a893000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788813211.292521:0:15777:0:(genops.c:844:class_export_destroy()) destroying export ffff948a6a893000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788813211.292527:0:15777:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788813211.293015:0:15777:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff948a6fbd5000 00000020:01000000:3.0:1788813211.293040:0:15777:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788813211.293044:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813211.293049:0:15777:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788813211.293053:0:15777:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff948a7653cd40) has no exports 00000020:00000080:3.0:1788813211.293074:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813211.293080:0:15777:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788813211.293083:0:15777:0:(genops.c:885:class_export_put()) final put ffff948a7b749800/OSS_uuid 00000020:00000080:3.0:1788813211.293085:0:15777:0:(genops.c:844:class_export_destroy()) destroying export ffff948a7b749800/OSS_uuid for OSS 00000020:01000000:3.0:1788813211.293089:0:15777:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788813211.293247:0:8403:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff948a6ec56600:8403] 0 exiting: rc = 1 00000100:00080000:0.0:1788813211.293444:0:6489:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788813211.293818:0:8405:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff948a7b565800:8405] 2 exiting: rc = 0 00000100:00100000:2.0:1788813211.293869:0:14190:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff948943701600:14190] 4 exiting: rc = 0 00000100:00100000:2.0:1788813211.294013:0:8404:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff948a6ec56000:8404] 1 exiting: rc = 0 00000100:00100000:2.0:1788813211.294073:0:10066:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff948942e12000:10066] 3 exiting: rc = 0 00000100:00100000:3.0:1788813211.295107:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295122:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295130:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295139:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295146:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295164:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295169:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295174:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295179:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295184:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295263:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295268:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295273:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295278:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295285:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295290:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295295:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295300:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295306:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295311:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295316:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295322:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295327:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295332:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295337:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295342:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295348:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295353:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295358:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295364:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295370:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295375:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295380:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295386:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295391:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295396:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295404:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295410:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295415:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295424:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295438:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295444:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295531:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295540:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295545:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295550:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295555:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295560:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295565:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295570:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295575:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295581:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295586:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295590:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295601:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295608:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295613:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295621:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295627:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295632:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295637:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295642:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295647:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.295652:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813211.304425:0:11298:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff948942cfc800:11298] 2 exiting: rc = 0 00000100:00100000:0.0:1788813211.304536:0:8406:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff948a7b565000:8406] 0 exiting: rc = 1 00000100:00100000:0.0:1788813211.304582:0:8407:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff948a6a88f200:8407] 1 exiting: rc = 0 00000100:00100000:2.0:1788813211.304970:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.304980:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.304987:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.304992:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.304997:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305003:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305008:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305014:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305019:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305025:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305030:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305036:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305042:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305047:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305052:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305058:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305063:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305068:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305074:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305079:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305083:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305089:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305093:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305099:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305120:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305125:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305130:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305134:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305139:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305144:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305150:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305171:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305177:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305182:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305265:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305271:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305277:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305282:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305287:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305292:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305298:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305303:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305308:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305312:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305317:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305322:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305326:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305331:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305336:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305340:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305344:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305350:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305355:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305360:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305366:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305370:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305375:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305380:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305385:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305396:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305401:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305406:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305410:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.305419:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813211.308597:0:8412:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff948a6eaf0800:8412] 2 exiting: rc = 0 00000100:00100000:0.0:1788813211.308894:0:8410:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff948a6eaf1600:8410] 0 exiting: rc = 1 00000100:00100000:2.0:1788813211.309145:0:8411:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff948a6eaf0400:8411] 1 exiting: rc = 0 00000100:00100000:3.0:1788813211.309436:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309444:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309461:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309468:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309473:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309505:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309514:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309520:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309527:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309532:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309538:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309555:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309560:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309566:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309572:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309578:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309585:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309591:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309597:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309603:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309608:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309614:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309620:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309626:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309632:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309637:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309643:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309648:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309654:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309659:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309680:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309687:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309692:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309698:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309704:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.309710:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310073:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310085:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310092:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310098:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310103:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310110:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310115:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310121:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310127:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310134:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310148:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310153:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310158:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310164:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310169:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310174:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310179:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310260:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310269:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310275:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310288:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310308:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310316:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310322:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310328:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310334:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310341:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813211.310354:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813211.316119:0:8413:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff948a7ca60400:8413] 0 exiting: rc = 1 00000100:00100000:3.0:1788813211.316324:0:8414:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff948a7ca61400:8414] 1 exiting: rc = 0 00000100:00100000:2.0:1788813211.316417:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316425:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316430:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316435:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316440:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316445:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316534:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316542:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316547:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316552:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316558:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316563:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316568:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316573:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316579:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316585:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316590:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316595:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316600:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316604:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316609:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316613:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316618:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316623:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316628:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316634:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316640:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316645:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316651:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316669:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316675:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316680:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316686:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316691:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316696:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316701:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316706:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316711:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316798:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316806:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316812:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316818:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316823:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316828:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316834:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316839:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316845:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316850:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316855:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316861:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316866:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316871:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316877:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316881:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316886:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316890:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316895:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316899:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316903:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316909:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316913:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316919:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.316924:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.317028:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813211.318986:0:8415:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff948a7ca60e00:8415] 0 exiting: rc = 1 00000100:00100000:3.0:1788813211.319383:0:8416:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff948a7ca61800:8416] 1 exiting: rc = 0 00000100:00100000:2.0:1788813211.319498:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319528:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319535:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319540:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319545:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319550:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319558:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319564:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319569:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319576:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319583:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319588:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319594:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319615:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319621:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319626:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319633:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319640:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319646:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319652:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319658:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319663:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319669:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319674:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319680:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319702:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319709:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319847:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319856:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319862:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319869:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319874:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319881:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319887:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319892:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319911:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319916:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319969:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319977:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319982:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319988:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319993:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.319999:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320004:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320011:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320017:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320023:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320028:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320033:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320054:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320061:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320068:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320073:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320079:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320085:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320091:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320097:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320103:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320109:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320115:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320122:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320127:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320133:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813211.320146:0:15777:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788813211.331699:0:15777:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788813232.763768:0:16542:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788813242.724477:0:17141:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788813242.724484:0:17141:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788813242.724485:0:17141:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788813242.724600:0:17141:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9489437db000 00000020:01000004:2.0:1788813242.724613:0:17141:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788813242.724620:0:17141:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788813242.724644:0:17141:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff948942dc99c0) 00000020:00000080:2.0:1788813242.724657:0:17141:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788813242.764086:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.765019:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788813242.767987:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788813242.769356:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.769548:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.769757:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.770037:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.770249:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.770495:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.771045:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.771329:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.771520:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.771744:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.772096:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.772354:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.772668:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.773028:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.773278:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.773495:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.773718:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.773988:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.774213:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.774396:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.774591:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.774769:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.775078:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.775259:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.775467:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.775666:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.775876:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.776188:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.776435:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788813242.776639:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.776962:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.777209:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788813242.777618:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788813242.777914:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788813242.778285:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788813242.778471:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788813242.778652:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788813242.779128:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788813242.779410:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788813242.779671:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788813242.779875:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788813242.782445:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788813242.782888:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788813242.783120:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788813242.783843:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788813242.784327:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788813242.784514:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788813242.784920:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788813242.785147:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788813242.785626:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1788813242.786500:0:17141:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788813242.786722:0:17141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788813242.786731:0:17141:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788813242.786743:0:17141:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff703ac6 00000020:01000004:2.0:1788813242.786751:0:17141:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788813242.786756:0:17141:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788813242.786761:0:17141:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9489437db000 from MGS 00000020:01000004:2.0:1788813242.786765:0:17141:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788813242.786775:0:17141:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff948942dcb380) 00000020:00000080:2.0:1788813242.786786:0:17141:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788813242.786895:0:17141:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9489437db000 from MGS, refs=2 00080000:01000000:2.0:1788813242.786900:0:17141:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788813242.786905:0:17141:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff703ad4 00000100:00100000:2.0:1788813242.787141:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788813242.787410:0:17141:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788813242.787416:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788813242.787899:0:17141:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788813242.787906:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788813242.788659:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788813242.788874:0:17141:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788813242.788880:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788813242.789576:0:17141:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788813242.789582:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788813242.789922:0:17141:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788813242.789927:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788813242.791634:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813242.791639:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813242.791641:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813242.792035:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813242.792037:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813242.792039:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813242.792523:0:17141:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788813242.797246:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788813242.797426:0:17141:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788813242.798418:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788813242.798469:0:17141:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788813242.798508:0:17141:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788813242.799460:0:17141:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788813242.799738:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813242.800102:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788813242.800108:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788813242.803064:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788813242.803083:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788813242.809815:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788813242.809826:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788813242.810700:0:17141:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788813242.810722:0:17141:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.113@tcp' 00000020:01000004:2.0:1788813242.810724:0:17141:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788813242.810751:0:17141:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.113@tcp (typ=mgc) 00000020:00000080:2.0:1788813242.810764:0:17141:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.113@tcp (ffff948942dccd40) 00000020:00000080:2.0:1788813242.810779:0:17141:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788813242.810852:0:17141:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a6eae5800@MGC192.168.202.113@tcp: add connection 192.168.202.113@tcp at head 00010000:00010000:2.0:1788813242.811033:0:17141:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.113@tcp-0 is initialized 00000040:01000000:2.0:1788813242.811040:0:17141:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788813242.814540:0:17160:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788813242.814628:0:17141:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.113@tcp (uuid b7e65740-fccd-471b-95df-6f83776cc95f) 00000020:00000080:0.0:1788813242.814651:0:17141:0:(genops.c:1384:class_connect()) connect: client b7e65740-fccd-471b-95df-6f83776cc95f, cookie 0xf32533d6ff703ae2 00000100:00080000:0.0:1788813242.814664:0:17141:0:(import.c:545:import_select_connection()) MGC192.168.202.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788813242.814675:0:17141:0:(import.c:666:import_select_connection()) MGC192.168.202.113@tcp: import ffff948a6eae5800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813242.814710:0:17141:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948944239180 x1875706313336064/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813242.814735:0:17141:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b7e65740-fccd-471b-95df-6f83776cc95f->MGS 00000020:01000004:0.0:1788813242.814761:0:17141:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788813242.814766:0:17141:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788813242.814780:0:17141:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff94894207cd40) 00000020:00000080:0.0:1788813242.814790:0:17141:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1788813242.819458:0:17158:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1788813242.820077:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b7e65740-fccd-471b-95df-6f83776cc95f:3624:1875706313336064:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788813242.820148:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813242.820430:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313336064 00000100:00100000:2.0:1788813242.820440:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313336064 00000100:00100000:2.0:1788813242.820484:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813242.820491:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943411c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3624:x1875706313336064:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788813242.820520:0:17154:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from b7e65740-fccd-471b-95df-6f83776cc95f@0@lo t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:2.0:1788813242.820554:0:17154:0:(genops.c:1384:class_connect()) connect: client b7e65740-fccd-471b-95df-6f83776cc95f, cookie 0xf32533d6ff703af0 00000100:00080000:2.0:1788813242.820682:0:17154:0:(import.c:65:import_set_state_nolock()) ffff948a6eae5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813242.821383:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943411c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+5:3624:x1875706313336064:12345-0@lo:250:mount.lustre.0 Request processed in 888us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813242.821393:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813242.828031:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813242.829462:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788813242.829475:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788813242.833000:0:3624:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788813242.833017:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.113@tcp: connect to target with instance 0 00000100:00080000:3.0:1788813242.833027:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788813242.833033:0:3624:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788813242.833038:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a6eae5800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788813242.833041:0:3624:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788813242.833050:0:3624:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788813242.833058:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b7e65740-fccd-471b-95df-6f83776cc95f:3624:1875706313336064:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788813242.837332:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788813242.837347:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788813242.837863:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788813242.837870:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788813242.840468:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813242.840683:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788813242.840691:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788813242.841668:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788813242.841676:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788813242.905728:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788813242.905976:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788813242.905982:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788813242.908318:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788813242.908333:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788813242.910381:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813242.910575:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788813242.910581:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788813242.911267:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788813242.911275:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788813242.911901:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788813242.912585:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788813242.912592:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788813242.913210:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788813242.913217:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788813242.914475:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813242.914664:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788813242.914669:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788813242.915649:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788813242.915658:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788813242.949849:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813242.950656:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788813242.950663:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788813242.952968:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788813242.952983:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788813242.954335:0:17141:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788813242.954348:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788813242.955627:0:17141:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788813242.955659:0:17141:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788813242.955672:0:17141:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788813242.955791:0:17141:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788813242.955830:0:17141:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.113@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788813242.955835:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788813242.955836:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788813242.955838:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813242.955839:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813242.955841:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813242.955842:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813242.955843:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788813242.955845:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788813242.955846:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813242.955848:0:17141:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788813242.955850:0:17141:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788813242.955853:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788813242.955854:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788813242.955855:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813242.955856:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813242.955857:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813242.955858:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813242.955860:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788813242.955861:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788813242.955862:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813242.955863:0:17141:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788813242.955891:0:17141:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788813242.955913:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313336192:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788813242.956272:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813242.956368:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b5d4240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813242.956492:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313336192 00000100:00100000:0.0:1788813242.956501:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313336192 00000100:00100000:0.0:1788813242.956541:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813242.956551:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943411050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+5:17141:x1875706313336192:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788813242.956601:0:17157:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788813242.956604:0:17157:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788813242.956606:0:17157:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788813242.957098:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788813242.957824:0:17157:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1788813242.959493:0:17179:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788813242.959500:0:17179:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788813242.959503:0:17179:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788813242.959506:0:17179:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788813242.959683:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788813242.959894:0:17157:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788813242.959905:0:17157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788813242.961684:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943411050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+5:17141:x1875706313336192:12345-0@lo:253:mount.lustre.0 Request processed in 5126us (5404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813242.961698:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813242.961788:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313336192:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788813242.961806:0:17141:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788813242.961810:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788813242.961811:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788813242.961813:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813242.961814:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813242.961825:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813242.961826:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813242.961828:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788813242.961829:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788813242.961831:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813242.961833:0:17141:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788813242.961852:0:17141:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9489437db000 from lustre-MDT0000 10000000:01000000:1.0:1788813242.961883:0:17141:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788813242.961886:0:17141:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788813242.961891:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff948942dccd40 10000000:01000000:1.0:1788813242.961896:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788813242.961904:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff948942dccd40 from 1 10000000:01000000:1.0:1788813242.961908:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788813242.962104:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813242.962115:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813242.962126:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813242.962146:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313336320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788813242.962207:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813242.962281:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b5d4780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813242.962387:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313336320 00000100:00100000:2.0:1788813242.962402:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313336320 00000100:00100000:2.0:1788813242.962491:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813242.962501:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+5:17141:x1875706313336320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813242.962515:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813242.962530:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc09c00/0xf32533d6ff703afe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703af7 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813242.962554:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc09c00/0xf32533d6ff703afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703af7 expref: 6 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813242.962566:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc09c00/0xf32533d6ff703afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703af7 expref: 6 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813242.962576:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09c00, rc 0) 00000100:00100000:2.0:1788813242.962622:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+6:17141:x1875706313336320:12345-0@lo:101:mount.lustre.0 Request processed in 123us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813242.962628:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813242.962703:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313336320:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813242.962717:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813242.962726:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813242.962790:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313336448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813242.962817:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813242.962909:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4a592d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813242.963107:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313336448 00000100:00100000:1.0:1788813242.963112:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313336448 00000100:00100000:1.0:1788813242.963136:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813242.963143:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943410850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+6:17141:x1875706313336448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813242.963251:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943410850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+6:17141:x1875706313336448:12345-0@lo:501:mount.lustre.0 Request processed in 107us (431us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813242.963258:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813242.963402:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313336448:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788813242.963436:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788813242.963465:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813242.963473:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813242.963481:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9489437db000 10000000:01000000:0.0:1788813242.963486:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788813242.963490:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9489437db000 10000000:01000000:0.0:1788813242.963493:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788813242.963496:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9489437db000 from 1 10000000:01000000:0.0:1788813242.963499:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788813242.963521:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813242.963528:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813242.963536:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813242.963549:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313336576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813242.963574:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813242.963593:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4a592d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813242.963656:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313336576 00000100:00100000:1.0:1788813242.963660:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313336576 00000100:00100000:1.0:1788813242.963676:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813242.963682:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+6:17141:x1875706313336576:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813242.963689:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813242.963701:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a43dac400/0xf32533d6ff703b0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703b05 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813242.963716:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a43dac400/0xf32533d6ff703b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703b05 expref: 7 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813242.963725:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a43dac400/0xf32533d6ff703b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703b05 expref: 7 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813242.963732:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac400, rc 0) 00000100:00100000:1.0:1788813242.963767:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+7:17141:x1875706313336576:12345-0@lo:101:mount.lustre.0 Request processed in 85us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813242.963773:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788813242.963862:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313336576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813242.963874:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703b0c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813242.963883:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703b0c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813242.963903:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788813242.963922:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703b0c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813242.963951:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a40031000/0xf32533d6ff703b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703b0c expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813242.963959:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788813242.963963:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788813242.963967:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9489437db000 10000000:01000000:0.0:1788813242.963970:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788813242.963974:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788813242.963976:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788813242.963989:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813242.963996:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813242.964003:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813242.964016:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313336704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813242.964041:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813242.964053:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4a592d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813242.964118:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313336704 00000100:00100000:2.0:1788813242.964123:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313336704 00000100:00100000:2.0:1788813242.964146:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813242.964166:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+7:17141:x1875706313336704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813242.964174:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813242.964183:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc09a00/0xf32533d6ff703b1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703b13 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813242.964207:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc09a00/0xf32533d6ff703b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703b13 expref: 8 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813242.964216:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc09a00/0xf32533d6ff703b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703b13 expref: 8 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813242.964230:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09a00, rc 0) 00000100:00100000:2.0:1788813242.964268:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+8:17141:x1875706313336704:12345-0@lo:101:mount.lustre.0 Request processed in 115us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813242.964274:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813242.964356:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313336704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813242.964367:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703b1a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813242.964381:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703b1a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813242.964425:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313336832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813242.964447:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813242.964476:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4a592d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813242.964526:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313336832 00000100:00100000:2.0:1788813242.964531:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313336832 00000100:00100000:2.0:1788813242.964549:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813242.964555:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+8:17141:x1875706313336832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813242.964678:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+9:17141:x1875706313336832:12345-0@lo:501:mount.lustre.0 Request processed in 123us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813242.964686:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813242.964823:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313336832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813242.964852:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313336960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813242.964891:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813242.964913:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4a592d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813242.965009:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313336960 00000100:00100000:2.0:1788813242.965014:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313336960 00000100:00100000:2.0:1788813242.965033:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813242.965039:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+9:17141:x1875706313336960:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813242.965830:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+9:17141:x1875706313336960:12345-0@lo:503:mount.lustre.0 Request processed in 788us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813242.965838:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788813242.965927:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313336960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813242.966530:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7e65740-fccd-471b-95df-6f83776cc95f:17180:1875706313337088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813242.966572:0:17180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813242.966640:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4a5923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813242.966673:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313337088 00000100:00100000:1.0:1788813242.966680:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313337088 00000100:00100000:1.0:1788813242.966747:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813242.966755:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+9:17180:x1875706313337088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813242.967463:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+9:17180:x1875706313337088:12345-0@lo:502:llog_process_th.0 Request processed in 705us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813242.967472:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788813242.967553:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7e65740-fccd-471b-95df-6f83776cc95f:17180:1875706313337088:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788813242.967584:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813242.967596:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813242.967598:0:17180:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788813242.967607:0:17180:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788813242.967610:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788813242.967625:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff948942078000) 00000020:00000080:0.0:1788813242.967643:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788813242.967649:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788813242.967733:0:17180:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788813242.967740:0:17180:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff703b28 00000020:00000080:0.0:1788813242.967990:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788813242.967994:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813242.967998:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813242.967999:0:17180:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788813242.968003:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813242.968006:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813242.968008:0:17180:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788813242.968011:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788813242.968018:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9489420799c0) 00000020:00000080:0.0:1788813242.968026:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788813242.968029:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788813242.968031:0:17180:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788813242.968034:0:17180:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788813242.968039:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788813242.968078:0:17180:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9489437db000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788813242.968088:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff94894207b380) 00000020:00000080:0.0:1788813242.968095:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788813242.968147:0:17180:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788813242.968151:0:17180:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff703b3d 00000020:00000080:0.0:1788813242.968255:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788813242.968260:0:17180:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788813242.968264:0:17180:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf32533d6ff703b44 00080000:01000000:0.0:1788813242.968268:0:17180:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788813242.968272:0:17180:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff703b4b 00010000:00010000:2.0:1788813243.025123:0:17180:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788813243.025551:0:17180:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1788813243.025812:0:17180:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788813243.026682:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff948942dc8000) 00000020:00000080:2.0:1788813243.026701:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788813243.026781:0:17180:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788813243.026790:0:17180:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff703b59 00000020:00000080:3.0:1788813243.027260:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788813243.029507:0:17180:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf32533d6ff703b60 00000020:00000080:3.0:1788813243.029925:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788813243.029969:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813243.029976:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813243.029978:0:17180:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788813243.029981:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788813243.029983:0:17180:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788813243.029985:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788813243.029986:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788813243.029987:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788813243.029990:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813243.029992:0:17180:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788813243.029994:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813243.029999:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813243.030000:0:17180:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788813243.030004:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788813243.030042:0:17180:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788813243.030058:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813243.030061:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813243.030063:0:17180:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788813243.030072:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813243.030076:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813243.030077:0:17180:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788813243.030080:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788813243.030086:0:17180:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:00000080:3.0:1788813243.030111:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788813243.030125:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff948a7653cd40) 00000020:00000080:3.0:1788813243.030138:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788813243.030148:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788813243.030232:0:17180:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788813243.030238:0:17180:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788813243.030244:0:17180:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff703b6e 00010000:00080000:3.0:1788813243.030273:0:17180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a44ca1000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.113@tcp at head 00010000:00010000:3.0:1788813243.031918:0:17180:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788813243.034068:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788813243.034085:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788813243.034120:0:17180:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788813243.034141:0:17180:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff703b75 00000100:00080000:0.0:1788813243.034278:0:17180:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788813243.034295:0:17180:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948a44ca1000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813243.034337:0:17180:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948944238000 x1875706313337216/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813243.034436:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313337216:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788813243.034539:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788813243.034614:0:17180:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788813243.034706:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313337344:0@lo:400:kworker.0 00000100:00100000:0.0:1788813243.034738:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788813243.034850:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813243.034854:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813243.034856:0:17180:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788813243.034860:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788813243.034862:0:17180:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788813243.034864:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788813243.034865:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788813243.034867:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788813243.034869:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813243.034870:0:17180:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788813243.034873:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788813243.034877:0:17180:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788813243.034880:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813243.034881:0:17180:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788813243.034884:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788813243.034888:0:17180:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:01000000:0.0:1788813243.034909:0:17180:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788813243.034912:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788813243.034988:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff948a779399c0) 00000020:00000080:0.0:1788813243.035019:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788813243.035025:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788813243.035087:0:17180:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788813243.035093:0:17180:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788813243.035099:0:17180:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff703b83 00010000:00080000:0.0:1788813243.035128:0:17180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a611ab800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.113@tcp at head 00010000:00010000:0.0:1788813243.035353:0:17180:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1788813243.035863:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313337344 00000100:00100000:3.0:1788813243.035871:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313337344 00000100:00100000:3.0:1788813243.035913:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813243.035922:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+9:3625:x1875706313337344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813243.036002:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+9:3625:x1875706313337344:12345-0@lo:400:kworker.0 Request processed in 81us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813243.036010:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813243.036059:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313337344:0@lo:400:kworker.0 00000040:01000000:0.0:1788813243.036604:0:17180:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788813243.036800:0:17180:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788813243.037085:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313337216 00000100:00100000:3.0:1788813243.037091:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313337216 00000100:00100000:3.0:1788813243.037118:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813243.037125:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1875706313337216:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788813243.037142:0:17167:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:0.0:1788813243.040413:0:17180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813243.041578:0:17180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788813243.047632:0:17180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788813243.048576:0:17186:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788813243.048582:0:17186:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788813243.049530:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788813243.049542:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788813243.049588:0:17180:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788813243.049610:0:17180:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff703b8a 00000100:00080000:1.0:1788813243.049622:0:17180:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813243.049635:0:17180:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff948a611ab800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813243.049675:0:17180:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a4700 x1875706313337472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813243.049707:0:17180:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788813243.049740:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313337472:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1788813243.049764:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813243.049768:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813243.049770:0:17180:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788813243.049772:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788813243.049775:0:17180:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788813243.049776:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813243.049778:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813243.049779:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788813243.049781:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813243.049782:0:17180:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788813243.049785:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813243.049789:0:17180:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788813243.049792:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813243.049793:0:17180:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000400:00000100:2.0:1788813243.049794:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313337472 offset 0 length 520: 4 00000020:00000080:1.0:1788813243.049796:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788813243.049799:0:17180:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:01000000:1.0:1788813243.049821:0:17180:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788813243.049824:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813243.049834:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff948a7b703380) 00000020:00000080:1.0:1788813243.049845:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788813243.049851:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788813243.049919:0:17180:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788813243.049925:0:17180:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788813243.049955:0:17180:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf32533d6ff703b98 00010000:00080000:1.0:1788813243.049993:0:17180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a507c3800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813243.050236:0:17180:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788813243.050307:0:17180:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788813243.050324:0:17180:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788813243.059843:0:17180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813243.060236:0:17180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788813243.060397:0:17180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788813243.061337:0:17188:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788813243.061342:0:17188:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788813243.061908:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788813243.061920:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788813243.061985:0:17180:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788813243.062015:0:17180:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff703b9f 00000100:00080000:1.0:1788813243.062027:0:17180:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813243.062122:0:17180:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948a507c3800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813243.062161:0:17180:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a4380 x1875706313337600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813243.062183:0:17180:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788813243.062238:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813243.062243:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813243.062244:0:17180:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788813243.062247:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813243.062251:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813243.062252:0:17180:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788813243.062254:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788813243.062256:0:17180:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788813243.062258:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813243.062260:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813243.062261:0:17180:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788813243.062263:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813243.062265:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813243.062267:0:17180:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788813243.062278:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788813243.062310:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7e65740-fccd-471b-95df-6f83776cc95f:17180:1875706313337728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813243.062389:0:17180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813243.062430:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313337728 00000100:00100000:1.0:1788813243.062437:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313337728 00000100:00100000:1.0:1788813243.062478:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813243.062486:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+9:17180:x1875706313337728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813243.062595:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+9:17180:x1875706313337728:12345-0@lo:502:llog_process_th.0 Request processed in 109us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813243.062602:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813243.062650:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48460780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813243.062671:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7e65740-fccd-471b-95df-6f83776cc95f:17180:1875706313337728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813243.062696:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813243.062700:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813243.062702:0:17180:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788813243.062705:0:17180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788813243.063147:0:17141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788813243.063181:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788813243.063205:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703b1a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813243.063217:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a40031400/0xf32533d6ff703b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703b1a expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813243.063226:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9489437db000 from 1 10000000:01000000:2.0:1788813243.063229:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788813243.063262:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09200/0xf32533d6ff703ba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813243.063271:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a6fc09200/0xf32533d6ff703ba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813243.063281:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a6fc09200/0xf32533d6ff703ba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813243.063295:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313337856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788813243.063326:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813243.063355:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe6fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813243.063375:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313337600:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788813243.063399:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313337600 offset 0 length 520: 4 00000100:00100000:0.0:1788813243.063419:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313337856 00000100:00100000:0.0:1788813243.063424:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313337856 00000100:00100000:0.0:1788813243.063459:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788813243.063466:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+9:17141:x1875706313337856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813243.063476:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813243.063499:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a40030400/0xf32533d6ff703bad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703ba6 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813243.063519:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a40030400/0xf32533d6ff703bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703ba6 expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813243.063530:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a40030400/0xf32533d6ff703bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703ba6 expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813243.063537:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a40030400, rc 0) 00000100:00100000:0.0:1788813243.063576:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+10:17141:x1875706313337856:12345-0@lo:101:mount.lustre.0 Request processed in 110us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813243.063583:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813243.064221:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313337856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813243.064248:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a6fc09200/0xf32533d6ff703ba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703bad expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813243.064256:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a6fc09200/0xf32533d6ff703ba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703bad expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813243.064786:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313337984:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788813243.064833:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813243.064865:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe6fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813243.066027:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313337984 00000100:00100000:3.0:1788813243.066049:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313337984 00000100:00100000:3.0:1788813243.066099:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813243.066110:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+10:17141:x1875706313337984:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788813243.066130:0:17157:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788813243.066136:0:17157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788813243.066253:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+10:17141:x1875706313337984:12345-0@lo:256:mount.lustre.0 Request processed in 145us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813243.066260:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813243.066343:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1875706313337216:12345-0@lo:38:llog_process_th.0 Request processed in 29217us (31804us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813243.066350:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788813243.066389:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a44ca1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813243.066394:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813243.066399:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313337216:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788813243.067685:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313337984:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788813243.068755:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788813243.068782:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09200/0xf32533d6ff703ba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703bad expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813243.068794:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a6fc09200/0xf32533d6ff703ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703bad expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813243.068802:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9489437db000 from 1 10000000:01000000:2.0:1788813243.068805:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813243.068842:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff703bb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813243.068849:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff703bb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813243.068859:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff703bb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813243.068879:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313338112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788813243.072426:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813243.072494:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe6fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813243.072571:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313338112 00000100:00100000:0.0:1788813243.072581:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313338112 00000100:00100000:0.0:1788813243.072640:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813243.072651:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+10:17141:x1875706313338112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813243.072666:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813243.072687:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a40031200/0xf32533d6ff703bbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703bb4 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813243.072732:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a40031200/0xf32533d6ff703bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703bb4 expref: 11 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813243.072744:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a40031200/0xf32533d6ff703bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703bb4 expref: 11 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813243.072752:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a40031200, rc 0) 00000100:00100000:0.0:1788813243.072804:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+11:17141:x1875706313338112:12345-0@lo:101:mount.lustre.0 Request processed in 155us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813243.072810:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788813243.073646:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313338112:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813243.073666:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff703bb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703bbb expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813243.073677:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff703bb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703bbb expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813243.073754:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313338240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813243.073791:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813243.074180:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe6fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813243.078878:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313338240 00000100:00100000:0.0:1788813243.078893:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313338240 00000100:00100000:0.0:1788813243.078984:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788813243.079007:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+11:17141:x1875706313338240:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813243.079241:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+11:17141:x1875706313338240:12345-0@lo:501:mount.lustre.0 Request processed in 247us (5448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813243.079249:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788813243.079300:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313338240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813243.079356:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313338368:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813243.079410:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813243.079441:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe6fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813243.079533:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313338368 00000100:00100000:1.0:1788813243.079538:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313338368 00000100:00100000:1.0:1788813243.079572:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813243.079579:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+11:17141:x1875706313338368:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813243.079668:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+11:17141:x1875706313338368:12345-0@lo:503:mount.lustre.0 Request processed in 88us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813243.079674:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788813243.080087:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313338368:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813243.080550:0:17190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7e65740-fccd-471b-95df-6f83776cc95f:17190:1875706313338496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813243.080589:0:17190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813243.080624:0:17190:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe6fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813243.080674:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313338496 00000100:00100000:0.0:1788813243.080679:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313338496 00000100:00100000:0.0:1788813243.080750:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788813243.080758:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+11:17190:x1875706313338496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813243.081407:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+11:17190:x1875706313338496:12345-0@lo:502:llog_process_th.0 Request processed in 648us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813243.081415:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788813243.081491:0:17190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7e65740-fccd-471b-95df-6f83776cc95f:17190:1875706313338496:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788813243.081517:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813243.081528:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813243.081531:0:17190:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788813243.081538:0:17190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9489437db000 00000020:00000080:2.0:1788813243.081547:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813243.081557:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813243.081560:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813243.081561:0:17190:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788813243.081564:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813243.081567:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813243.081568:0:17190:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788813243.081572:0:17190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9489437db000 00000020:00000080:2.0:1788813243.081574:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813243.081630:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813243.081634:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813243.081635:0:17190:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788813243.081638:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813243.081640:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813243.081642:0:17190:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788813243.081645:0:17190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9489437db000 00000020:00000080:2.0:1788813243.081647:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813243.081667:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813243.081670:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813243.081671:0:17190:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788813243.081673:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813243.081676:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813243.081677:0:17190:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788813243.081681:0:17190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9489437db000 00000020:00000080:2.0:1788813243.081683:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788813243.081718:0:17190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7e65740-fccd-471b-95df-6f83776cc95f:17190:1875706313338624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813243.081756:0:17190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813243.084430:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313338624 00000100:00100000:3.0:1788813243.084444:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313338624 00000100:00100000:3.0:1788813243.084489:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788813243.084498:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+11:17190:x1875706313338624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813243.084635:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+11:17190:x1875706313338624:12345-0@lo:502:llog_process_th.0 Request processed in 138us (2879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813243.084643:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788813243.094186:0:17190:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe6fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813243.094239:0:17190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7e65740-fccd-471b-95df-6f83776cc95f:17190:1875706313338624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788813243.094283:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813243.094290:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813243.094293:0:17190:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788813243.094298:0:17190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788813243.094372:0:17141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788813243.094396:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813243.094418:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff703bb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703bbb expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813243.094431:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff703bb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703bbb expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813243.094482:0:17141:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788813243.094485:0:17141:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9489437db000 10000000:01000000:0.0:1788813243.094489:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9489437db000 10000000:01000000:0.0:1788813243.094492:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788813243.094498:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9489437db000 from 1 10000000:01000000:0.0:1788813243.094501:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788813243.094534:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813243.094542:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813243.094551:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813243.094570:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313338752:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813243.094634:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813243.094662:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313338752 00000100:00100000:0.0:1788813243.094664:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48e92480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813243.094668:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313338752 00000100:00100000:3.0:1788813243.094706:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788813243.094715:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+11:17141:x1875706313338752:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813243.094727:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813243.094744:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948943657200/0xf32533d6ff703bc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703bc2 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813243.094768:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948943657200/0xf32533d6ff703bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703bc2 expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813243.094778:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948943657200/0xf32533d6ff703bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703bc2 expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813243.094786:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657200, rc 0) 00000100:00100000:3.0:1788813243.094825:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+12:17141:x1875706313338752:12345-0@lo:101:mount.lustre.0 Request processed in 112us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813243.094832:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813243.095174:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313338752:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813243.095187:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703bc9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813243.095206:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703bc9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813243.095256:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313338880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813243.095282:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813243.095306:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48e92480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813243.098198:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313338880 00000100:00100000:3.0:1788813243.098212:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313338880 00000100:00100000:3.0:1788813243.098262:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788813243.098271:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+12:17141:x1875706313338880:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813243.098421:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+12:17141:x1875706313338880:12345-0@lo:501:mount.lustre.0 Request processed in 152us (3138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813243.098428:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813243.099244:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313338880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813243.099300:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313339008:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813243.099350:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813243.099377:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a48e92480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813243.103620:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313339008 00000100:00100000:3.0:1788813243.103643:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313339008 00000100:00100000:3.0:1788813243.103696:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813243.103705:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+12:17141:x1875706313339008:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813243.103855:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+12:17141:x1875706313339008:12345-0@lo:503:mount.lustre.0 Request processed in 151us (4506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813243.103863:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813243.104107:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313339008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813243.105830:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7e65740-fccd-471b-95df-6f83776cc95f:17195:1875706313339136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813243.105897:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813243.106123:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813243.106382:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313339136 00000100:00100000:2.0:1788813243.106391:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313339136 00000100:00100000:2.0:1788813243.106472:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788813243.106482:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+12:17195:x1875706313339136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813243.106602:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+12:17195:x1875706313339136:12345-0@lo:502:llog_process_th.0 Request processed in 121us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813243.106614:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788813243.106691:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7e65740-fccd-471b-95df-6f83776cc95f:17195:1875706313339136:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788813243.106744:0:17195:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788813243.106758:0:17195:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff948a7793b380) 00000020:00000080:0.0:1788813243.106776:0:17195:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788813243.106864:0:17195:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9489437db000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788813243.106867:0:17195:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9489437db000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788813243.106870:0:17195:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9489437db000 4 00010000:00080000:0.0:1788813243.106901:0:17195:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a6e8eb000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.113@tcp at head 00010000:00010000:0.0:1788813243.109138:0:17195:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788813243.109523:0:17195:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788813243.109564:0:17195:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788813243.109578:0:17195:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf32533d6ff703bd7 00000100:00080000:0.0:1788813243.109588:0:17195:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788813243.109608:0:17195:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff948a6e8eb000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813243.109645:0:17195:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948944238700 x1875706313339264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813243.109687:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313339264:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788813243.109763:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788813243.109816:0:17195:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788813243.110458:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944239c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7e65740-fccd-471b-95df-6f83776cc95f:17195:1875706313339392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813243.110502:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813243.110526:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313339392 00000100:00100000:0.0:1788813243.110532:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313339392 00000100:00100000:0.0:1788813243.110565:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788813243.110572:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+12:17195:x1875706313339392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813243.110669:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+12:17195:x1875706313339392:12345-0@lo:502:llog_process_th.0 Request processed in 96us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813243.110676:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788813243.110713:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46774540 going to sleep for 11 seconds 00000100:00100000:0.0:1788813243.110733:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944239c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7e65740-fccd-471b-95df-6f83776cc95f:17195:1875706313339392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813243.110763:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944239c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7e65740-fccd-471b-95df-6f83776cc95f:17195:1875706313339520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813243.110787:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813243.110802:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313339520 00000100:00100000:0.0:1788813243.110805:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313339520 00000100:00100000:0.0:1788813243.110820:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788813243.110825:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+12:17195:x1875706313339520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813243.110869:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+12:17195:x1875706313339520:12345-0@lo:502:llog_process_th.0 Request processed in 44us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813243.110881:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788813243.110902:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45939e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813243.110911:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944239c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7e65740-fccd-471b-95df-6f83776cc95f:17195:1875706313339520:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788813243.110926:0:17195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788813243.112574:0:17141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788813243.112606:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788813243.112621:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703bc9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813243.112634:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a40031600/0xf32533d6ff703bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703bc9 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788813243.112676:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788813243.112677:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788813243.112679:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813243.112680:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813243.112681:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813243.112682:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813243.112684:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788813243.112685:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788813243.112687:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813243.112688:0:17141:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788813243.112691:0:17141:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788813243.112694:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788813243.112695:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788813243.112696:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813243.112697:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813243.112698:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813243.112699:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813243.112700:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788813243.112701:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788813243.112702:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813243.112703:0:17141:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788813243.112723:0:17141:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788813243.112738:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313339648:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788813243.112797:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813243.112829:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813243.113302:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313339264 00000100:00100000:2.0:1788813243.113310:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313339264 00000100:00100000:2.0:1788813243.113350:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813243.113359:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1875706313339264:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788813243.113422:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1875706313339264:12345-0@lo:38:llog_process_th.0 Request processed in 63us (3658us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788813243.113429:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813243.115436:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313339648 00000100:00100000:1.0:1788813243.115448:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313339648 00000100:00100000:1.0:1788813243.115494:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788813243.115503:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+12:17141:x1875706313339648:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788813243.115541:0:17154:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788813243.115554:0:17154:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788813243.117100:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788813243.117110:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a6e8eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788813243.117116:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788813243.117120:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313339264:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788813243.121222:0:17154:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788813243.121238:0:17154:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788813243.121274:0:17178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788813243.121278:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788813243.121300:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948943657a00/0xf32533d6ff703bde lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813243.121319:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a40030400/0xf32533d6ff703bad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703ba6 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813243.121328:0:17178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948943657a00/0xf32533d6ff703bde lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813243.121366:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a40030400/0xf32533d6ff703bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff703ba6 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813243.121384:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a40030400/0xf32533d6ff703bad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff703ba6 expref: 12 pid: 17154 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813243.121399:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875706313339776:0@lo:104: 00000100:00100000:3.0:1788813243.121459:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813243.121497:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813243.121498:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+12:17141:x1875706313339648:12345-0@lo:253:mount.lustre.0 Request processed in 5995us (8698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813243.121508:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788813243.121536:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17141:1875706313339648:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788813243.121546:0:17141:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788813243.121550:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788813243.121552:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788813243.121553:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813243.121554:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813243.121555:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813243.121556:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813243.121557:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788813243.121559:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788813243.121569:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:1.0:1788813243.121569:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313339776 00000020:01000004:3.0:1788813243.121570:0:17141:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788813243.121575:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313339776 00000020:02000000:3.0:1788813243.121581:0:17141:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788813243.121605:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813243.121612:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7e65740-fccd-471b-95df-6f83776cc95f+3:17178:x1875706313339776:12345-0@lo:104: 00010000:00010000:1.0:1788813243.121625:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a6fc09200/0xf32533d6ff703ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703bad expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813243.121668:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813243.121673:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7e65740-fccd-471b-95df-6f83776cc95f+3:17178:x1875706313339776:12345-0@lo:104: Request processed in 63us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813243.121679:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813243.121706:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875706313339776:0@lo:104: 00010000:00010000:1.0:1788813243.121719:0:17178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948943657a00/0xf32533d6ff703bde lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813243.122289:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813243.122297:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a6fc09200/0xf32533d6ff703ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703bad expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813243.122305:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09200 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:2.0:1788813243.122309:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc09200/0xf32533d6ff703ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff703bad expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813243.122317:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a6fc09200/0xf32533d6ff703ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff703bad expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813243.122323:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc09200/0xf32533d6ff703ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff703bad expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813243.122329:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788813243.122361:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a6fc09200/0xf32533d6ff703ba6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703bad expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813243.122367:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813243.122389:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a6fc09200/0xf32533d6ff703ba6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703bad expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813243.122407:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a6fc09200/0xf32533d6ff703ba6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703bad expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813243.122423:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813243.122425:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813243.122427:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813243.122442:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313339904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813243.122477:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813243.122887:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313339904 00000100:00100000:1.0:1788813243.122895:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313339904 00010000:00010000:1.0:1788813243.122917:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a40030400/0xf32533d6ff703bad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703ba6 expref: 12 pid: 17154 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813243.122959:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813243.122967:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+12:3626:x1875706313339904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813243.122984:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813243.123541:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a40030400/0xf32533d6ff703bad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703ba6 expref: 12 pid: 17154 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813243.123555:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a40030400/0xf32533d6ff703bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff703ba6 expref: 12 pid: 17154 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813243.123570:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a40030400/0xf32533d6ff703bad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff703ba6 expref: 12 pid: 17154 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813243.123586:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948943657a00/0xf32533d6ff703bde lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813243.123595:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948943657a00/0xf32533d6ff703bde lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788813243.123611:0:17147:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002333126s 00010000:00010000:1.0:1788813243.123616:0:17147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948943657a00/0xf32533d6ff703bde lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813243.123623:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948943657a00/0xf32533d6ff703bde lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813243.123630:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948943657a00/0xf32533d6ff703bde lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813243.123638:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948943657a00/0xf32533d6ff703bde lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813243.123644:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657a00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813243.123648:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948943657a00/0xf32533d6ff703bde lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813243.123663:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948943657a00/0xf32533d6ff703bde lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813243.123686:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948943657a00/0xf32533d6ff703bde lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813243.123696:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813243.123750:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+11:3626:x1875706313339904:12345-0@lo:103:ldlm_bl.0 Request processed in 783us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813243.123757:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813243.123801:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313339904:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813243.124237:0:17178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948943657a00/0xf32533d6ff703bde lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813243.124247:0:17178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948943657a00/0xf32533d6ff703bde lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813243.124253:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948943657a00/0xf32533d6ff703bde lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788813243.144595:0:17141:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788813243.145601:0:17141:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788813243.146201:0:17203:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788813243.146221:0:17141:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788813243.146751:0:17203:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788813243.147980:0:17202:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788813243.147986:0:17202:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00080000:3.0:1788813243.148415:0:17204:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff94894424df80 x1875706313340032/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813243.148429:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00000040:01000000:0.0:1788813243.148859:0:17141:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788813243.148898:0:17141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788813243.150320:0:17141:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788813243.150513:0:17141:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788813243.150584:0:17141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813243.151846:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788813243.152573:0:17203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788813243.152630:0:17203:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788813243.152787:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788813243.152823:0:17141:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788813243.154381:0:17141:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1788813243.162822:0:17141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788813243.165116:0:17141:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788813243.165157:0:17141:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb265018b3988 00100000:10000000:1.0:1788813243.165165:0:17141:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788813243.166152:0:17141:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788813243.166169:0:17141:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788813243.166187:0:17141:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788813243.166216:0:17141:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788813243.168061:0:17141:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813243.168861:0:17141:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788813243.818547:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813244.133871:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788813244.197328:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 10000000:01000000:3.0:1788813244.645172:0:17160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788813244.646743:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9489437db000 from 7 10000000:01000000:3.0:1788813244.646749:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788813244.646799:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656c00/0xf32533d6ff703be5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813244.646812:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948943656c00/0xf32533d6ff703be5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813244.646823:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948943656c00/0xf32533d6ff703be5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813244.646847:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313340160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813244.646909:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813244.647127:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813244.648292:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313340160 00000100:00100000:2.0:1788813244.648304:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313340160 00000100:00100000:2.0:1788813244.648408:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813244.648420:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+11:17160:x1875706313340160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813244.648435:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813244.648451:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703bec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703be5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813244.648476:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703be5 expref: 12 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813244.648489:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703be5 expref: 12 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813244.648497:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09800, rc 0) 00000100:00100000:2.0:1788813244.648573:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+12:17160:x1875706313340160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813244.648586:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788813244.648661:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313340160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813244.648684:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948943656c00/0xf32533d6ff703be5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703bec expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813244.648693:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948943656c00/0xf32533d6ff703be5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703bec expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813244.648749:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313340288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788813244.648785:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813244.650416:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813244.651021:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313340288 00000100:00100000:0.0:1788813244.651030:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313340288 00000100:00100000:0.0:1788813244.651070:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788813244.651079:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+12:17160:x1875706313340288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788813244.651100:0:17157:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788813244.651120:0:17157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788813244.651123:0:17157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788813244.651237:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+12:17160:x1875706313340288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 159us (2451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813244.651245:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788813244.651292:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313340288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788813244.651335:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788813244.651345:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656c00/0xf32533d6ff703be5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703bec expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813244.651355:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948943656c00/0xf32533d6ff703be5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703bec expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813244.836054:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813245.156692:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788813245.220000:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788813245.869061:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813246.244267:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788813246.884347:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813247.269547:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00000001:02000400:0.0:1788813247.460587:0:17447:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788813247.908967:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813248.292003:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00000020:00000004:1.0:1788813248.292110:0:17499:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788813248.292308:0:17499:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1788813248.356195:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788813248.356202:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788813248.356206:0:8:0:(import.c:65:import_set_state_nolock()) ffff948a44ca1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813248.356213:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 396 00000100:00080000:2.0:1788813248.356220:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788813248.356240:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948a44ca1000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813248.356263:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a764cbb80 x1875706313340544/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788813248.356280:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813248.356284:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813248.356287:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813248.356290:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813248.356292:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788813248.356295:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788813248.356297:0:8:0:(import.c:65:import_set_state_nolock()) ffff948a6e8eb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813248.356301:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff948a6e8eb000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813248.356310:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a764cad80 x1875706313340672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813248.356333:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313340544:0@lo:38:kworker.0 00000100:00100000:2.0:1788813248.356389:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813248.356439:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313340672:0@lo:38:kworker.0 00000100:00100000:2.0:1788813248.356464:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813248.356595:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813248.356604:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313340416:0@lo:400:kworker.0 00000100:00100000:1.0:1788813248.356635:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813248.356690:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313340672 00000100:00100000:1.0:1788813248.356699:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313340672 00000100:00100000:1.0:1788813248.356730:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813248.356738:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313340672:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788813248.356762:0:17164:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:1.0:1788813248.356798:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf32533d6ff703bf3 00000004:00100000:1.0:1788813248.356814:0:17164:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788813248.356973:0:17164:0:(import.c:65:import_set_state_nolock()) ffff948a50e3c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813248.357014:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875706313340672:12345-0@lo:38:kworker.0 Request processed in 276us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813248.357021:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813248.357443:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313340544 00000100:00100000:0.0:1788813248.357448:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313340544 00000100:00100000:0.0:1788813248.357474:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813248.357480:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875706313340544:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788813248.357492:0:17168:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788813248.358287:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313340416 00000100:00100000:2.0:1788813248.358293:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313340416 00000100:00100000:2.0:1788813248.358339:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788813248.358347:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+12:3628:x1875706313340416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813248.358408:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+12:3628:x1875706313340416:12345-0@lo:400:kworker.0 Request processed in 62us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813248.358414:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788813248.358471:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313340416:0@lo:400:kworker.0 00010000:00080000:2.0:1788813248.358506:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff948a764cad80 x1875706313340672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788813248.358520:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788813248.358527:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788813248.358532:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788813248.358535:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a6e8eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788813248.358540:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875706313340672:0@lo:38:kworker.0 00000100:00100000:0.0:1788813248.375518:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875706313340544:12345-0@lo:38:kworker.0 Request processed in 18029us (19120us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788813248.375531:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788813248.375585:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a44ca1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788813248.375590:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788813248.375606:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313340544:0@lo:38:kworker.0 00010000:00010000:3.0:1788813248.932458:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813249.316039:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00000020:00000004:1.0:1788813249.321866:0:17549:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788813249.323305:0:17549:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788813249.956417:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813250.340060:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00010000:00010000:0.0:1788813250.992015:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813251.371101:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00010000:00010000:0.0:1788813252.008995:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813252.394116:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00010000:00010000:0.0:1788813253.032503:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813253.412026:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00000100:00100000:0.0:1788813253.484022:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813243/real 1788813243] req@ffff9489433a4380 x1875706313337600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813253 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813253.484055:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9489433a4380 x1875706313337600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813253 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813253.484065:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813243/real 1788813243] req@ffff9489433a4700 x1875706313337472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813253 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813253.484077:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9489433a4700 x1875706313337472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813253 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788813253.484107:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a507c3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788813253.484138:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788813253.484142:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313337600:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788813253.484148:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a611ab800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788813253.484154:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788813253.484165:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313337472:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788813253.484257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788813253.484264:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788813253.484268:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a44ca1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813253.484277:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 401 00000100:00080000:1.0:1788813253.484284:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788813253.484298:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948a44ca1000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813253.484426:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313340800:0@lo:400:kworker.0 00000100:00100000:1.0:1788813253.484440:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a7480 x1875706313340928/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813253.484460:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813253.484463:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788813253.484466:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a611ab800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813253.484470:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 396 00000100:00080000:1.0:1788813253.484473:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788813253.484501:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff948a611ab800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813253.484516:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a6a00 x1875706313341056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813253.484526:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813253.484530:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788813253.484534:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a507c3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788813253.484535:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788813253.484539:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 396 00000100:00080000:1.0:1788813253.484543:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788813253.484548:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948a507c3800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813253.484564:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a4e00 x1875706313341184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788813253.484622:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813253.484633:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313341312:0@lo:400:kworker.0 00000100:00100000:1.0:1788813253.484684:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813253.484810:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313340800 00000100:00100000:0.0:1788813253.484822:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313340800 00000100:00100000:0.0:1788813253.484893:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788813253.484905:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313341312 00000100:00100000:2.0:1788813253.484912:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313341312 00000100:00100000:0.0:1788813253.484915:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+12:3628:x1875706313340800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813253.485330:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+12:3628:x1875706313340800:12345-0@lo:400:kworker.0 Request processed in 416us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813253.485342:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813253.485371:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313340800:0@lo:400:kworker.0 00000100:00100000:0.0:1788813253.485401:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313340928:0@lo:38:kworker.0 00000100:00100000:0.0:1788813253.485438:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813253.485467:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313341056:0@lo:8:kworker.0 00000100:00100000:3.0:1788813253.485487:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313340928 00000100:00100000:3.0:1788813253.485499:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313340928 00000400:00000100:0.0:1788813253.485499:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313341056 offset 0 length 520: 4 00000100:00100000:0.0:1788813253.485531:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313341184:0@lo:8:kworker.0 00000100:00100000:3.0:1788813253.485552:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000400:00000100:0.0:1788813253.485560:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313341184 offset 0 length 520: 4 00000100:00100000:3.0:1788813253.485563:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1875706313340928:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788813253.485588:0:17167:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788813253.488763:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813253.488788:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313341312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813253.488920:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313341312:12345-0@lo:400:kworker.0 Request processed in 142us (4235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813253.488966:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788813253.489039:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9489433a4700 x1875706313341312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813253.489071:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313341312:0@lo:400:kworker.0 00000100:00100000:3.0:1788813253.500198:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1875706313340928:12345-0@lo:38:kworker.0 Request processed in 14061us (14183us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813253.500215:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788813253.504170:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a44ca1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813253.504199:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788813253.504206:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313340928:0@lo:38:kworker.0 00010000:00010000:1.0:1788813254.055271:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813254.436043:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788813255.077517:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813255.400528:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788813255.461015:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00000020:01000004:0.0:1788813255.578261:0:17894:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788813255.578266:0:17894:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788813255.578267:0:17894:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788813255.578383:0:17894:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff948a7b569800 00000020:01000004:0.0:1788813255.578402:0:17894:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788813255.578415:0:17894:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788813255.578429:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff948a7793cd40) 00000020:00000080:0.0:1788813255.578447:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788813255.624047:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788813255.625430:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.626095:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.626583:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.626747:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.627026:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.627307:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.627481:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.627669:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.627901:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.628216:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.628588:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.628858:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.629182:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.629361:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.629512:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.630021:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.630296:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.630505:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.630737:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.631110:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.631299:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.631491:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.631733:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.632064:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.632282:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.632517:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.632702:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.633001:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.633278:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.633496:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788813255.633865:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.634198:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.634392:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788813255.635367:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788813255.635766:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788813255.636080:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788813255.636324:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788813255.636563:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788813255.636758:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788813255.637069:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788813255.637318:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788813255.637557:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788813255.637758:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788813255.638100:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788813255.638293:0:17894:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1788813255.640533:0:17894:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788813255.640757:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788813255.640770:0:17894:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788813255.640797:0:17894:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff703c01 00000020:01000004:2.0:1788813255.640805:0:17894:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788813255.640827:0:17894:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.113@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788813255.640831:0:17894:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788813255.640836:0:17894:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788813255.640865:0:17894:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788813255.640869:0:17894:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.113@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788813255.645739:0:17894:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788813255.645859:0:17894:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.113@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788813255.645864:0:17894:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788813255.645865:0:17894:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788813255.645867:0:17894:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813255.645868:0:17894:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813255.645869:0:17894:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813255.645870:0:17894:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813255.645871:0:17894:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788813255.645874:0:17894:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813255.645875:0:17894:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813255.645880:0:17894:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788813255.645882:0:17894:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788813255.645884:0:17894:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788813255.645885:0:17894:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813255.645886:0:17894:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813255.645887:0:17894:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813255.645888:0:17894:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813255.645889:0:17894:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788813255.645890:0:17894:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813255.645891:0:17894:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813255.645919:0:17894:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788813255.646031:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313341440:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788813255.646203:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813255.646304:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4843d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.646387:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313341440 00000100:00100000:2.0:1788813255.646395:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313341440 00000100:00100000:2.0:1788813255.646455:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788813255.646466:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+12:17894:x1875706313341440:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788813255.646500:0:17156:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788813255.646504:0:17156:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788813255.646511:0:17156:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788813255.646959:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+12:17894:x1875706313341440:12345-0@lo:253:mount.lustre.0 Request processed in 464us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.646969:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788813255.647247:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313341440:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788813255.647260:0:17894:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788813255.647263:0:17894:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788813255.647265:0:17894:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788813255.647266:0:17894:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813255.647267:0:17894:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813255.647268:0:17894:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813255.647270:0:17894:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813255.647271:0:17894:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788813255.647273:0:17894:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813255.647274:0:17894:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788813255.647304:0:17894:0:(tgt_mount.c:101:server_register_mount()) register mount ffff948a7b569800 from lustre-MDT0001 10000000:01000000:3.0:1788813255.647331:0:17894:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788813255.647334:0:17894:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788813255.647343:0:17894:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff948942dccd40 local copy 00010000:00010000:3.0:1788813255.647353:0:17894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813255.647448:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313341568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813255.647483:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813255.647548:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4843d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.647582:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313341568 00000100:00100000:2.0:1788813255.647587:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313341568 00000100:00100000:2.0:1788813255.647659:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788813255.647667:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+12:17894:x1875706313341568:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813255.647733:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+12:17894:x1875706313341568:12345-0@lo:501:mount.lustre.0 Request processed in 67us (249us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788813255.647745:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788813255.647805:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313341568:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788813255.647817:0:17894:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788813255.647832:0:17894:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788813255.647838:0:17894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.647847:0:17894:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813255.647870:0:17894:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff948a7b569800 10000000:01000000:3.0:1788813255.647874:0:17894:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788813255.647879:0:17894:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff948942dccd40 10000000:01000000:3.0:1788813255.647881:0:17894:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788813255.647884:0:17894:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff948942dccd40 from 1 10000000:01000000:3.0:1788813255.647887:0:17894:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788813255.647906:0:17894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656600/0xf32533d6ff703c08 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.647913:0:17894:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948943656600/0xf32533d6ff703c08 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.647927:0:17894:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948943656600/0xf32533d6ff703c08 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813255.647959:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313341696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813255.647983:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813255.648193:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4843d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813255.648322:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313341696 00000100:00100000:0.0:1788813255.648328:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313341696 00000100:00100000:0.0:1788813255.648354:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788813255.648360:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+12:17894:x1875706313341696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813255.648371:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813255.648384:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a40031c00/0xf32533d6ff703c0f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703c08 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.648417:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a40031c00/0xf32533d6ff703c0f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703c08 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.648427:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a40031c00/0xf32533d6ff703c0f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703c08 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.648435:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a40031c00, rc 0) 00000100:00100000:0.0:1788813255.648474:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+13:17894:x1875706313341696:12345-0@lo:101:mount.lustre.0 Request processed in 114us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813255.648481:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788813255.648548:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313341696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813255.648560:0:17894:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948943656600/0xf32533d6ff703c08 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703c0f expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.648569:0:17894:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948943656600/0xf32533d6ff703c08 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703c0f expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813255.648583:0:17894:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788813255.648599:0:17894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656600/0xf32533d6ff703c08 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703c0f expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.648605:0:17894:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948943656600/0xf32533d6ff703c08 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703c0f expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813255.648613:0:17894:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff948a7b569800 10000000:01000000:3.0:1788813255.648617:0:17894:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788813255.648620:0:17894:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff948a7b569800 from 1 10000000:01000000:3.0:1788813255.648622:0:17894:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788813255.648636:0:17894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.648643:0:17894:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.648656:0:17894:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813255.648669:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313341824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813255.648694:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813255.648706:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4843d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813255.648750:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313341824 00000100:00100000:0.0:1788813255.648754:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313341824 00000100:00100000:0.0:1788813255.648783:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788813255.648789:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+13:17894:x1875706313341824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813255.648796:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813255.648804:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a40031a00/0xf32533d6ff703c1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703c16 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.648818:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a40031a00/0xf32533d6ff703c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703c16 expref: 14 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.648825:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a40031a00/0xf32533d6ff703c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703c16 expref: 14 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.648831:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a40031a00, rc 0) 00000100:00100000:0.0:1788813255.648865:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+14:17894:x1875706313341824:12345-0@lo:101:mount.lustre.0 Request processed in 76us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813255.648871:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788813255.649022:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313341824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813255.649043:0:17894:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703c1d expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.649052:0:17894:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703c1d expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813255.649062:0:17894:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788813255.649079:0:17894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703c1d expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.649087:0:17894:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948943657600/0xf32533d6ff703c16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703c1d expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813255.649093:0:17894:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788813255.649096:0:17894:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788813255.649100:0:17894:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff948a7b569800 10000000:01000000:3.0:1788813255.649107:0:17894:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788813255.649110:0:17894:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788813255.649113:0:17894:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788813255.649126:0:17894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.649202:0:17894:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.649212:0:17894:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813255.649225:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313341952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813255.649249:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813255.649275:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4843d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813255.649451:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313341952 00000100:00100000:1.0:1788813255.649456:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313341952 00000100:00100000:1.0:1788813255.649622:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788813255.649631:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+14:17894:x1875706313341952:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813255.649640:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813255.649649:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a43dad600/0xf32533d6ff703c2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703c24 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.649664:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a43dad600/0xf32533d6ff703c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703c24 expref: 15 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.649672:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a43dad600/0xf32533d6ff703c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703c24 expref: 15 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.649686:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dad600, rc 0) 00000100:00100000:1.0:1788813255.649718:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+15:17894:x1875706313341952:12345-0@lo:101:mount.lustre.0 Request processed in 89us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813255.649724:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788813255.649741:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313341952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813255.649752:0:17894:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703c2b expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.649761:0:17894:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703c2b expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813255.650761:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788813255.651430:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813255.655531:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788813255.655623:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788813255.655632:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788813255.655640:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788813255.655650:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1788813255.655657:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1788813255.655664:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1788813255.655670:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788813255.655677:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788813255.655684:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1788813255.655698:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1788813255.655705:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1788813255.655712:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1788813255.655718:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788813255.655724:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788813255.655731:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1788813255.655738:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788813255.655744:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788813255.655818:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1788813255.655833:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788813255.655845:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788813255.655900:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788813255.655911:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788813255.655928:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1788813255.656051:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788813255.656176:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313342080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813255.656236:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813255.656312:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313342080 00000100:00100000:1.0:1788813255.656321:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313342080 00000100:00100000:3.0:1788813255.656353:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4843da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813255.656414:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813255.656422:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+15:17894:x1875706313342080:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813255.656565:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+15:17894:x1875706313342080:12345-0@lo:501:mount.lustre.0 Request processed in 143us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813255.656573:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788813255.656636:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313342080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813255.656659:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313342208:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813255.656689:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813255.656788:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4843da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.656860:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313342208 00000100:00100000:2.0:1788813255.656866:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313342208 00000100:00100000:2.0:1788813255.656888:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788813255.656894:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+15:17894:x1875706313342208:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813255.657504:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+15:17894:x1875706313342208:12345-0@lo:503:mount.lustre.0 Request processed in 609us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.657509:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788813255.657617:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313342208:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788813255.658404:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788813255.658475:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313342336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813255.658516:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813255.658584:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4843d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813255.658677:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313342336 00000100:00100000:1.0:1788813255.658683:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313342336 00000100:00100000:1.0:1788813255.658717:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788813255.658729:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+15:17894:x1875706313342336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813255.659226:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+15:17894:x1875706313342336:12345-0@lo:502:mount.lustre.0 Request processed in 498us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813255.659232:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788813255.659348:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313342336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788813255.660655:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788813255.660692:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1788813255.660700:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1788813255.660707:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1788813255.660714:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1788813255.660721:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1788813255.660729:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1788813255.660735:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1788813255.660742:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1788813255.660752:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1788813255.660759:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1788813255.660766:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1788813255.660776:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1788813255.660789:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1788813255.660800:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1788813255.660812:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1788813255.660825:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1788813255.660839:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1788813255.660849:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1788813255.660857:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1788813255.660863:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1788813255.660872:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1788813255.660879:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1788813255.660886:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1788813255.660893:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1788813255.660900:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1788813255.660907:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1788813255.660914:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1788813255.660920:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1788813255.660927:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1788813255.660968:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1788813255.660983:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1788813255.661006:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1788813255.661020:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1788813255.661033:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1788813255.661046:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1788813255.661059:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1788813255.661085:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1788813255.661102:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1788813255.661114:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1788813255.661121:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1788813255.661129:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1788813255.661136:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1788813255.661143:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1788813255.661178:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313342464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813255.661234:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813255.661271:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4843d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.661294:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313342464 00000100:00100000:2.0:1788813255.661301:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313342464 00000100:00100000:2.0:1788813255.661351:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788813255.661360:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+15:17894:x1875706313342464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813255.661471:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+15:17894:x1875706313342464:12345-0@lo:502:mount.lustre.0 Request processed in 112us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.661481:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788813255.661633:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313342464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788813255.661676:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1788813255.661684:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788813255.663191:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813255.663204:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813255.663206:0:17898:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788813255.663211:0:17898:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788813255.663214:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788813255.663228:0:17898:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff948a765399c0) 00000020:00000080:3.0:1788813255.663251:0:17898:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788813255.663257:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788813255.663345:0:17898:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788813255.663353:0:17898:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff703c39 00000020:00000080:3.0:1788813255.663578:0:17898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788813255.663583:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813255.663587:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813255.663596:0:17898:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788813255.663600:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813255.663604:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813255.663605:0:17898:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788813255.663608:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788813255.663616:0:17898:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff948a76538000) 00000020:00000080:3.0:1788813255.663627:0:17898:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788813255.663631:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788813255.663633:0:17898:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788813255.663635:0:17898:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788813255.663641:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788813255.663689:0:17898:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a7b569800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788813255.663700:0:17898:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff948a7653b380) 00000020:00000080:3.0:1788813255.663711:0:17898:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788813255.663793:0:17898:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788813255.663799:0:17898:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff703c4e 00000020:00000080:3.0:1788813255.663891:0:17898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788813255.663899:0:17898:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788813255.663903:0:17898:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf32533d6ff703c55 00080000:01000000:3.0:1788813255.663909:0:17898:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788813255.663913:0:17898:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff703c5c 00010000:00010000:3.0:1788813255.722873:0:17898:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788813255.723447:0:17898:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1788813255.723707:0:17898:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788813255.725007:0:17898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788813255.725018:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813255.725024:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813255.725026:0:17898:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788813255.725029:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813255.725044:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813255.725046:0:17898:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788813255.725049:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788813255.725055:0:17898:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:00000080:3.0:1788813255.725104:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788813255.725122:0:17898:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff948a6adb4d40) 00000020:00000080:3.0:1788813255.725145:0:17898:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788813255.725150:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788813255.725223:0:17898:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788813255.725230:0:17898:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788813255.725236:0:17898:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff703c6a 00010000:00080000:3.0:1788813255.725270:0:17898:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a6e9e8000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.113@tcp at head 00010000:00010000:3.0:1788813255.726923:0:17898:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788813255.728232:0:17898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788813255.728247:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788813255.728285:0:17898:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788813255.728305:0:17898:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff703c71 00000100:00080000:1.0:1788813255.728315:0:17898:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813255.728325:0:17898:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff948a6e9e8000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813255.728364:0:17898:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a5c00 x1875706313342592/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813255.728403:0:17898:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788813255.728460:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813255.728464:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.728466:0:17898:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788813255.728468:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788813255.728471:0:17898:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788813255.728473:0:17898:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813255.728474:0:17898:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813255.728476:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788813255.728478:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.728480:0:17898:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788813255.728482:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813255.728486:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.728488:0:17898:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788813255.728491:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788813255.728524:0:17898:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788813255.728537:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813255.728540:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.728541:0:17898:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788813255.728544:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788813255.728545:0:17898:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788813255.728546:0:17898:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813255.728548:0:17898:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813255.728550:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788813255.728552:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.728553:0:17898:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788813255.728555:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813255.728558:0:17898:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788813255.728561:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.728562:0:17898:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788813255.728565:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788813255.728568:0:17898:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:01000000:1.0:1788813255.728594:0:17898:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788813255.728597:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813255.728608:0:17898:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff948a7b700000) 00000020:00000080:1.0:1788813255.728621:0:17898:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788813255.728627:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788813255.728681:0:17898:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788813255.728688:0:17898:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788813255.728693:0:17898:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff703c7f 00010000:00080000:1.0:1788813255.728720:0:17898:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a611ac800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813255.728962:0:17898:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1788813255.729724:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313342592:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788813255.729814:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1788813255.730147:0:17898:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:0.0:1788813255.730347:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788813255.730353:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788813255.730357:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a44ca1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813255.730362:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 406 00000100:00080000:0.0:1788813255.730366:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788813255.730374:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948a44ca1000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813255.730400:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948944239c00 x1875706313342720/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813255.730416:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813255.730420:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813255.730423:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813255.730426:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788813255.730469:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313342592 00000100:00100000:0.0:1788813255.730476:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313342592 00000100:00100000:0.0:1788813255.730509:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813255.730516:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875706313342592:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788813255.730539:0:17168:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:0.0:1788813255.730580:0:17168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff703c86 00000004:00100000:0.0:1788813255.730595:0:17168:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788813255.730600:0:17168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788813255.730659:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313342848:0@lo:400:kworker.0 00000100:00100000:0.0:1788813255.730698:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813255.730752:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313342848 00000100:00100000:0.0:1788813255.730755:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313342848 00000040:01000000:1.0:1788813255.730864:0:17898:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1788813255.731109:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313342720:0@lo:38:kworker.0 00000100:00100000:3.0:1788813255.731137:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813255.731460:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813255.731474:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313342848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813255.731523:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313342848:12345-0@lo:400:kworker.0 Request processed in 50us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813255.731530:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813255.731557:0:17167:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788813255.731564:0:17167:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:0.0:1788813255.731598:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff948944238380 x1875706313342848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813255.731611:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313342848:0@lo:400:kworker.0 00000040:00080000:1.0:1788813255.733546:0:17898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813255.733885:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313342720 00000100:00100000:0.0:1788813255.733897:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313342720 00000100:00100000:3.0:1788813255.734676:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813255.734686:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3624:x1875706313342720:12345-0@lo:38:kworker.0 00000040:00080000:1.0:1788813255.734915:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788813255.735976:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:3.0:1788813255.736239:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3624:x1875706313342720:12345-0@lo:38:kworker.0 Request processed in 1549us (5096us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788813255.736250:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813255.736305:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788813255.736314:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a44ca1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813255.736318:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788813255.736322:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313342720:0@lo:38:kworker.0 00000100:00080000:3.0:1788813255.737302:0:17168:0:(import.c:65:import_set_state_nolock()) ffff948943446800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813255.737393:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3624:x1875706313342592:12345-0@lo:38:llog_process_th.0 Request processed in 6875us (7578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813255.737402:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813255.737718:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788813255.737729:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788813255.737739:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788813255.737746:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788813255.737748:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a6e9e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788813255.737764:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313342592:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788813255.739160:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313342976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813255.739227:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813255.739280:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313342976 00000100:00100000:3.0:1788813255.739286:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313342976 00000100:00100000:3.0:1788813255.739329:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788813255.739338:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3627:x1875706313342976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788813255.739371:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788813255.739417:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3627:x1875706313342976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813255.739423:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788813255.739463:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313342976:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788813255.739904:0:17903:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788813255.739909:0:17903:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788813255.742358:0:17898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788813255.742374:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788813255.742420:0:17898:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788813255.742444:0:17898:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff703c8d 00000100:00080000:1.0:1788813255.742454:0:17898:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813255.742465:0:17898:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff948a611ac800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813255.742503:0:17898:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a6d80 x1875706313343104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813255.742521:0:17898:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788813255.742584:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813255.742589:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.742591:0:17898:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788813255.742594:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788813255.742597:0:17898:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788813255.742598:0:17898:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813255.742610:0:17898:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813255.742612:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788813255.742614:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.742616:0:17898:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788813255.742619:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813255.742623:0:17898:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788813255.742626:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.742628:0:17898:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788813255.742631:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788813255.742635:0:17898:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:01000000:1.0:1788813255.742661:0:17898:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788813255.742664:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813255.742675:0:17898:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff948a7b7019c0) 00000020:00000080:1.0:1788813255.742688:0:17898:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788813255.742694:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788813255.742765:0:17898:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00000100:00080000:0.0:1788813255.742969:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813255.742974:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813255.742977:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813255.742980:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00080000:01000000:1.0:1788813255.744403:0:17898:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788813255.744418:0:17898:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf32533d6ff703c9b 00010000:00080000:1.0:1788813255.744476:0:17898:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a7b790000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813255.744697:0:17898:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000100:00100000:2.0:1788813255.745173:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313343104:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788813255.745237:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313343104 offset 0 length 520: 4 00000040:01000000:1.0:1788813255.745924:0:17898:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788813255.746004:0:17898:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788813255.748049:0:17898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813255.748490:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788813255.748619:0:17898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788813255.749156:0:17906:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788813255.749161:0:17906:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788813255.751838:0:17898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788813255.751851:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788813255.751897:0:17898:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788813255.751920:0:17898:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff703ca2 00000100:00080000:3.0:1788813255.751961:0:17898:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788813255.751972:0:17898:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff948a7b790000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813255.752009:0:17898:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94894424f480 x1875706313343232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813255.752033:0:17898:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788813255.752090:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813255.752094:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813255.752096:0:17898:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788813255.752100:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813255.752103:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813255.752105:0:17898:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788813255.752108:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788813255.752117:0:17898:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788813255.752120:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813255.752123:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813255.752124:0:17898:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788813255.752127:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813255.752130:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813255.752131:0:17898:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788813255.752135:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788813255.752160:0:17898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813255.752163:0:17898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813255.752164:0:17898:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788813255.752167:0:17898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:0.0:1788813255.754300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813255.754310:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813255.754313:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813255.754316:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788813255.754425:0:17894:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788813255.754487:0:17894:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788813255.754510:0:17894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703c2b expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813255.754523:0:17894:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948943657a00/0xf32533d6ff703c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703c2b expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813255.754531:0:17894:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a7b569800 from 1 10000000:01000000:2.0:1788813255.754534:0:17894:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788813255.754568:0:17894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08200/0xf32533d6ff703ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813255.754577:0:17894:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a6fc08200/0xf32533d6ff703ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813255.754588:0:17894:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a6fc08200/0xf32533d6ff703ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813255.754611:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313343360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788813255.754678:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813255.754721:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4596e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.754746:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313343232:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788813255.754784:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313343232 offset 0 length 520: 4 00000100:00100000:2.0:1788813255.755179:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313343360 00000100:00100000:2.0:1788813255.755187:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313343360 00000100:00100000:2.0:1788813255.755248:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788813255.755259:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+15:17894:x1875706313343360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813255.755273:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813255.755286:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703cb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703ca9 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813255.755317:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703ca9 expref: 16 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813255.755328:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703ca9 expref: 16 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813255.755336:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08c00, rc 0) 00000100:00100000:2.0:1788813255.755386:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+16:17894:x1875706313343360:12345-0@lo:101:mount.lustre.0 Request processed in 129us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.755393:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788813255.755482:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313343360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813255.755498:0:17894:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a6fc08200/0xf32533d6ff703ca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703cb0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.755512:0:17894:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a6fc08200/0xf32533d6ff703ca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703cb0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813255.756124:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313343488:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788813255.756162:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813255.756180:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45838180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813255.756300:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313343488 00000100:00100000:3.0:1788813255.756306:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313343488 00000100:00100000:3.0:1788813255.756345:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788813255.756352:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+16:17894:x1875706313343488:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788813255.756368:0:17157:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788813255.756423:0:17157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788813255.756426:0:17157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788813255.756494:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+16:17894:x1875706313343488:12345-0@lo:256:mount.lustre.0 Request processed in 143us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813255.756501:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788813255.759820:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313343488:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788813255.760458:0:17894:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788813255.760484:0:17894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08200/0xf32533d6ff703ca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703cb0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.760496:0:17894:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a6fc08200/0xf32533d6ff703ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703cb0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813255.760505:0:17894:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a7b569800 from 1 10000000:01000000:0.0:1788813255.760508:0:17894:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813255.760544:0:17894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40030400/0xf32533d6ff703cb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.760553:0:17894:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a40030400/0xf32533d6ff703cb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.760564:0:17894:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a40030400/0xf32533d6ff703cb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813255.760584:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313343616:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813255.760642:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813255.760686:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45838180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.760905:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313343616 00000100:00100000:2.0:1788813255.760913:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313343616 00000100:00100000:2.0:1788813255.760990:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788813255.761002:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+16:17894:x1875706313343616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813255.761016:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813255.761029:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703cbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703cb7 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813255.761052:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703cbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703cb7 expref: 17 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813255.761063:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703cbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703cb7 expref: 17 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813255.761082:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09400, rc 0) 00000100:00100000:2.0:1788813255.761124:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+17:17894:x1875706313343616:12345-0@lo:101:mount.lustre.0 Request processed in 125us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.761131:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788813255.761301:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313343616:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813255.761315:0:17894:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a40030400/0xf32533d6ff703cb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703cbe expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.761324:0:17894:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a40030400/0xf32533d6ff703cb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703cbe expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813255.761466:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813255.761499:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313343744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813255.761527:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813255.761546:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45838780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.761731:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313343744 00000100:00100000:2.0:1788813255.761736:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313343744 00000100:00100000:2.0:1788813255.761782:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788813255.761790:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+17:17894:x1875706313343744:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813255.761873:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+17:17894:x1875706313343744:12345-0@lo:501:mount.lustre.0 Request processed in 84us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.761880:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788813255.764129:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313343744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813255.764188:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313343872:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813255.764262:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813255.764309:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45838780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813255.765571:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313343872 00000100:00100000:1.0:1788813255.765582:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313343872 00000100:00100000:1.0:1788813255.765674:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788813255.765685:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+17:17894:x1875706313343872:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813255.765824:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+17:17894:x1875706313343872:12345-0@lo:503:mount.lustre.0 Request processed in 141us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813255.765841:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788813255.765968:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313343872:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788813255.766336:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813255.766412:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344000:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813255.766444:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813255.767717:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45838180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.767796:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313344000 00000100:00100000:2.0:1788813255.767804:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313344000 00000100:00100000:2.0:1788813255.767847:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788813255.767855:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+17:17894:x1875706313344000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813255.768002:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+17:17894:x1875706313344000:12345-0@lo:502:mount.lustre.0 Request processed in 148us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.768011:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813255.768198:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813255.768594:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788813255.768623:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788813255.768639:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788813255.768653:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788813255.768676:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1788813255.768690:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788813255.768704:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1788813255.768718:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1788813255.768731:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788813255.768744:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1788813255.768757:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1788813255.768875:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813255.768923:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813255.768984:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45838180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.769110:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313344128 00000100:00100000:2.0:1788813255.769115:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313344128 00000100:00100000:2.0:1788813255.769141:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788813255.769148:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+17:17894:x1875706313344128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813255.769240:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+17:17894:x1875706313344128:12345-0@lo:502:mount.lustre.0 Request processed in 92us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.769261:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788813255.769538:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813255.769586:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1788813255.769596:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788813255.770239:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813255.770377:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.770380:0:17908:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788813255.770387:0:17908:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a7b569800 00000020:00000080:1.0:1788813255.770390:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788813255.770399:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813255.770402:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.770403:0:17908:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788813255.770405:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813255.770408:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.770409:0:17908:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788813255.770412:0:17908:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a7b569800 00000020:00000080:1.0:1788813255.770415:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788813255.770476:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813255.770479:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.770480:0:17908:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788813255.770483:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813255.770485:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.770486:0:17908:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788813255.770490:0:17908:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a7b569800 00000020:00000080:1.0:1788813255.770492:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788813255.770510:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813255.770512:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.770514:0:17908:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788813255.770516:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813255.770519:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.770520:0:17908:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788813255.770524:0:17908:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a7b569800 00000020:00000080:1.0:1788813255.770526:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788813255.770548:0:17908:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813255.770552:0:17908:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813255.770559:0:17908:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788813255.770562:0:17908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1788813255.770861:0:17894:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788813255.770885:0:17894:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813255.770909:0:17894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40030400/0xf32533d6ff703cb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703cbe expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.770921:0:17894:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a40030400/0xf32533d6ff703cb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703cbe expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813255.770993:0:17894:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788813255.770996:0:17894:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff948a7b569800 10000000:01000000:0.0:1788813255.770999:0:17894:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff948a7b569800 10000000:01000000:0.0:1788813255.771003:0:17894:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788813255.771009:0:17894:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a7b569800 from 1 10000000:01000000:0.0:1788813255.771011:0:17894:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788813255.771042:0:17894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.771060:0:17894:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.771082:0:17894:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813255.771105:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813255.771161:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813255.771194:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45838780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813255.772014:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313344256 00000100:00100000:3.0:1788813255.772023:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313344256 00000100:00100000:3.0:1788813255.772087:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788813255.772097:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+17:17894:x1875706313344256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813255.772112:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813255.772127:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948943656400/0xf32533d6ff703ccc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703cc5 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.772150:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948943656400/0xf32533d6ff703ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703cc5 expref: 18 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.772169:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948943656400/0xf32533d6ff703ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703cc5 expref: 18 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.772178:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656400, rc 0) 00000100:00100000:3.0:1788813255.772224:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17894:x1875706313344256:12345-0@lo:101:mount.lustre.0 Request processed in 128us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813255.772230:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788813255.772591:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344256:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813255.772608:0:17894:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703ccc expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.772618:0:17894:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703ccc expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788813255.779101:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788813255.779393:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813255.779551:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788813255.779573:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1788813255.779587:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1788813255.779601:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1788813255.779628:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1788813255.779640:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1788813255.779652:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1788813255.779664:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1788813255.779676:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1788813255.779688:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1788813255.779702:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1788813255.779717:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1788813255.779730:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1788813255.779743:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1788813255.779755:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1788813255.781896:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1788813255.782008:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1788813255.782025:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1788813255.783374:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1788813255.783403:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1788813255.783442:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1788813255.783457:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1788813255.783469:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1788813255.783484:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1788813255.783497:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1788813255.783511:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1788813255.783524:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1788813255.783536:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1788813255.783565:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1788813255.783579:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788813255.783686:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813255.783758:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813255.787137:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942db4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788813255.791893:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313344384 00000100:00100000:3.0:1788813255.791909:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313344384 00000100:00100000:3.0:1788813255.791989:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788813255.792001:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17894:x1875706313344384:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813255.792217:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17894:x1875706313344384:12345-0@lo:501:mount.lustre.0 Request processed in 218us (8457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813255.792225:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788813255.793424:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813255.793476:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344512:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813255.793531:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813255.793567:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942db4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788813255.793873:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313344512 00000100:00100000:3.0:1788813255.793879:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313344512 00000100:00100000:3.0:1788813255.793925:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788813255.793952:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17894:x1875706313344512:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813255.794054:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17894:x1875706313344512:12345-0@lo:503:mount.lustre.0 Request processed in 122us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813255.794061:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788813255.794163:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344512:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788813255.794638:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813255.794707:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813255.794748:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813255.794961:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942db4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788813255.795905:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313344640 00000100:00100000:3.0:1788813255.795915:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313344640 00000100:00100000:3.0:1788813255.795989:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813255.795999:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17894:x1875706313344640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813255.796147:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17894:x1875706313344640:12345-0@lo:502:mount.lustre.0 Request processed in 149us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813255.796161:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813255.796230:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788813255.796640:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788813255.796672:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788813255.796688:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788813255.796703:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788813255.796717:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788813255.796730:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788813255.796741:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788813255.796751:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788813255.796762:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788813255.797915:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788813255.797962:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788813255.797980:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788813255.797992:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788813255.798005:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788813255.798019:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788813255.798032:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788813255.798047:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788813255.798060:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788813255.798083:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788813255.798100:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788813255.798114:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788813255.798127:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788813255.798141:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788813255.798156:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788813255.798171:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788813255.798185:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788813255.798216:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788813255.798232:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788813255.798258:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788813255.799392:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788813255.799419:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788813255.799433:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788813255.799446:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788813255.799457:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788813255.799470:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788813255.799484:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788813255.799495:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788813255.799508:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788813255.799521:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788813255.799534:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788813255.799546:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788813255.799559:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788813255.799588:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788813255.799603:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788813255.799616:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788813255.799629:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788813255.799643:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788813255.799657:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788813255.799716:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813255.800900:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813255.803170:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe76600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.807388:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313344768 00000100:00100000:2.0:1788813255.807405:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313344768 00000100:00100000:2.0:1788813255.807502:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788813255.807514:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17894:x1875706313344768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813255.807693:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17894:x1875706313344768:12345-0@lo:502:mount.lustre.0 Request processed in 182us (6796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.807711:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788813255.812136:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788813255.812464:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788813255.812493:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788813255.812534:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813255.812609:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813255.812649:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe76600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.812895:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313344896 00000100:00100000:2.0:1788813255.812903:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313344896 00000100:00100000:2.0:1788813255.813322:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788813255.813334:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17894:x1875706313344896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813255.813460:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17894:x1875706313344896:12345-0@lo:502:mount.lustre.0 Request processed in 129us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.813468:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788813255.813538:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313344896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788813255.813596:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1788813255.813605:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788813255.825046:0:17913:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788813255.825064:0:17913:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff948a7b704d40) 00000020:00000080:1.0:1788813255.825098:0:17913:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788813255.825189:0:17913:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a7b569800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788813255.825193:0:17913:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a7b569800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788813255.825196:0:17913:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7b569800 3 00010000:00080000:1.0:1788813255.825226:0:17913:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94894372e000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.113@tcp at head 00010000:00010000:0.0:1788813255.836197:0:17913:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788813255.838653:0:17913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788813255.838709:0:17913:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788813255.838724:0:17913:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf32533d6ff703cda 00000100:00080000:0.0:1788813255.838736:0:17913:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788813255.838748:0:17913:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94894372e000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813255.838868:0:17913:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948944238380 x1875706313345024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813255.838888:0:17913:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788813255.838926:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813255.838972:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813255.838975:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813255.838978:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788813255.840386:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875706313345024:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788813255.840475:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813255.841562:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313345024 00000100:00100000:0.0:1788813255.841575:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313345024 00000100:00100000:0.0:1788813255.841615:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813255.841623:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313345024:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788813255.841655:0:17164:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:0.0:1788813255.841881:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf32533d6ff703ce1 00000004:00100000:0.0:1788813255.841896:0:17164:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788813255.841925:0:17164:0:(import.c:65:import_set_state_nolock()) ffff948a7b57a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813255.842019:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875706313345024:12345-0@lo:38:llog_process_th.0 Request processed in 395us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813255.842027:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788813255.842102:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff948944238380 x1875706313345024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813255.842115:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788813255.842125:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788813255.842135:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788813255.842141:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788813255.842143:0:3624:0:(import.c:65:import_set_state_nolock()) ffff94894372e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788813255.842150:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875706313345024:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788813255.842303:0:17913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1788813255.847105:0:17894:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788813255.847152:0:17894:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788813255.847216:0:17894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703ccc expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813255.847232:0:17894:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a40030c00/0xf32533d6ff703cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703ccc expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788813255.847306:0:17894:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788813255.847309:0:17894:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788813255.847310:0:17894:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813255.847312:0:17894:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813255.847313:0:17894:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813255.847314:0:17894:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813255.847316:0:17894:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788813255.847323:0:17894:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813255.847324:0:17894:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813255.847329:0:17894:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788813255.847331:0:17894:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788813255.847332:0:17894:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788813255.847333:0:17894:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813255.847334:0:17894:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813255.847335:0:17894:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813255.847336:0:17894:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813255.847337:0:17894:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788813255.847338:0:17894:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813255.847339:0:17894:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813255.847367:0:17894:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788813255.847389:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313345152:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788813255.847466:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813255.847507:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943306000 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.847530:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313345152 00000100:00100000:2.0:1788813255.847539:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313345152 00000100:00100000:2.0:1788813255.847593:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788813255.847602:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17894:x1875706313345152:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788813255.847642:0:17157:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788813255.847657:0:17157:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788813255.851872:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788813255.851904:0:17157:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788813255.851923:0:17157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788813255.852147:0:17178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788813255.852152:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788813255.852175:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a43dad200/0xf32533d6ff703ce8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.852194:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703be5 expref: 18 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.852213:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703cb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703ca9 expref: 18 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.852221:0:17178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948a43dad200/0xf32533d6ff703ce8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.852281:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff703ca9 expref: 18 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.852296:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703cb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff703ca9 expref: 18 pid: 17156 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813255.852311:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875706313345280:0@lo:104: 00000100:00100000:1.0:1788813255.852376:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813255.852419:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff703be5 expref: 18 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.852427:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703bec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff703be5 expref: 18 pid: 17156 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813255.852434:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875706313345408:0@lo:104: 00000100:00100000:1.0:1788813255.852453:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813255.852539:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff948942db43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.852553:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17894:x1875706313345152:12345-0@lo:253:mount.lustre.0 Request processed in 4951us (5086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.852563:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788813255.852570:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313345280 00000100:00100000:1.0:1788813255.852576:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313345280 00000100:00100000:1.0:1788813255.852602:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313345408 00000100:00100000:1.0:1788813255.852605:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313345408 00000100:00100000:1.0:1788813255.852617:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813255.852626:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7e65740-fccd-471b-95df-6f83776cc95f+4:17178:x1875706313345280:12345-0@lo:104: 00010000:00010000:1.0:1788813255.852646:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a6fc08200/0xf32533d6ff703ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703cb0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.852687:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813255.852693:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7e65740-fccd-471b-95df-6f83776cc95f+4:17178:x1875706313345280:12345-0@lo:104: Request processed in 69us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813255.852700:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813255.852713:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813255.852719:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7e65740-fccd-471b-95df-6f83776cc95f+3:17178:x1875706313345408:12345-0@lo:104: 00010000:00010000:1.0:1788813255.852726:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948943656c00/0xf32533d6ff703be5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703bec expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.852765:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813255.852771:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7e65740-fccd-471b-95df-6f83776cc95f+3:17178:x1875706313345408:12345-0@lo:104: Request processed in 52us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813255.852777:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788813255.852795:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813255.852800:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a6fc08200/0xf32533d6ff703ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703cb0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.852807:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08200 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813255.852811:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc08200/0xf32533d6ff703ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff703cb0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.852819:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a6fc08200/0xf32533d6ff703ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff703cb0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813255.852827:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc08200/0xf32533d6ff703ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff703cb0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813255.852839:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813255.852864:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a6fc08200/0xf32533d6ff703ca9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703cb0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.852871:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813255.852891:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a6fc08200/0xf32533d6ff703ca9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703cb0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.852898:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a6fc08200/0xf32533d6ff703ca9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703cb0 expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.852908:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813255.852912:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948943656c00/0xf32533d6ff703be5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703bec expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.852917:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656c00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813255.852920:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948943656c00/0xf32533d6ff703be5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff703bec expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.852926:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948943656c00/0xf32533d6ff703be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff703bec expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813255.852948:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948943656c00/0xf32533d6ff703be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff703bec expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.853144:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813255.853223:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:17894:1875706313345152:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788813255.853235:0:17894:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788813255.853239:0:17894:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788813255.853240:0:17894:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788813255.853247:0:17894:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813255.853249:0:17894:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813255.853250:0:17894:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813255.853252:0:17894:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813255.853253:0:17894:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788813255.853255:0:17894:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813255.853256:0:17894:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788813255.853339:0:17894:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 10000000:01000000:1.0:1788813255.853613:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813255.853645:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948943656c00/0xf32533d6ff703be5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703bec expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.853651:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813255.853675:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948943656c00/0xf32533d6ff703be5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703bec expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.853681:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948943656c00/0xf32533d6ff703be5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703bec expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.853694:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813255.853696:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813255.853698:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813255.853713:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313345536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813255.853717:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813255.853727:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313345664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813255.853746:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813255.853808:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875706313345280:0@lo:104: 00000100:00100000:1.0:1788813255.853816:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875706313345408:0@lo:104: 00010000:00010000:1.0:1788813255.853830:0:17178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948a43dad200/0xf32533d6ff703ce8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813255.853849:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313345536 00000100:00100000:0.0:1788813255.853854:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313345536 00010000:00010000:0.0:1788813255.853876:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703cb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703ca9 expref: 18 pid: 17156 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813255.853908:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813255.853915:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+18:3628:x1875706313345536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813255.853925:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813255.853959:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703cb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703ca9 expref: 18 pid: 17156 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.853971:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff703ca9 expref: 18 pid: 17156 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.853984:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703cb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff703ca9 expref: 18 pid: 17156 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.853994:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813255.854025:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+17:3628:x1875706313345536:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813255.854105:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813255.854130:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813255.854181:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313345536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813255.854316:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313345664 00000100:00100000:1.0:1788813255.854321:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313345664 00010000:00010000:1.0:1788813255.854337:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703bec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703be5 expref: 17 pid: 17156 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813255.854363:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813255.854369:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7e65740-fccd-471b-95df-6f83776cc95f+17:3626:x1875706313345664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813255.854376:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813255.854380:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703bec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703be5 expref: 17 pid: 17156 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.854388:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff703be5 expref: 17 pid: 17156 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.854408:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703bec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff703be5 expref: 17 pid: 17156 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.854420:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948a43dad200/0xf32533d6ff703ce8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.854428:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a43dad200/0xf32533d6ff703ce8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788813255.854442:0:17149:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002333126s 00010000:00010000:1.0:1788813255.854446:0:17149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a43dad200/0xf32533d6ff703ce8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.854454:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a43dad200/0xf32533d6ff703ce8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.854532:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a43dad200/0xf32533d6ff703ce8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.854540:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a43dad200/0xf32533d6ff703ce8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.854545:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813255.854549:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a43dad200/0xf32533d6ff703ce8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.854557:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a43dad200/0xf32533d6ff703ce8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.854572:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a43dad200/0xf32533d6ff703ce8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.854588:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813255.854618:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7e65740-fccd-471b-95df-6f83776cc95f+16:3626:x1875706313345664:12345-0@lo:103:ldlm_bl.0 Request processed in 249us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813255.854624:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788813255.854645:0:17178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948a43dad200/0xf32533d6ff703ce8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.854653:0:17178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a43dad200/0xf32533d6ff703ce8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813255.854659:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a43dad200/0xf32533d6ff703ce8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813255.855410:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313345664:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1788813255.867137:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788813255.867151:0:17920:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788813255.867155:0:17920:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788813255.867564:0:17921:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788813255.868057:0:17921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813255.870196:0:17921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788813255.870291:0:17921:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788813255.871469:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788813255.872623:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424d500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17922:1875706313345792:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788813255.872710:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813255.872750:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b4c9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.872906:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313345792 00000100:00100000:2.0:1788813255.872914:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313345792 00000100:00100000:2.0:1788813255.872984:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813255.872995:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17922:x1875706313345792:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788813255.873103:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17922:x1875706313345792:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 110us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.873111:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813255.873196:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424d500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17922:1875706313345792:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788813255.873230:0:17922:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788813255.873280:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17922:1875706313345920:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788813255.873313:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813255.873339:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6104f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.873497:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313345920 00000100:00100000:2.0:1788813255.873502:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313345920 00000100:00100000:2.0:1788813255.873527:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813255.873534:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17922:x1875706313345920:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788813255.873647:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17922:x1875706313345920:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 112us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.873653:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788813255.873719:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17922:1875706313345920:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788813255.873787:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17922:1875706313346048:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788813255.873814:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813255.873838:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6104ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.873988:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313346048 00000100:00100000:2.0:1788813255.873993:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313346048 00000100:00100000:2.0:1788813255.874016:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813255.874041:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17922:x1875706313346048:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788813255.874090:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17922:x1875706313346048:12345-0@lo:900:lod0001_rec0000.0 Request processed in 60us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.874096:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788813255.874215:0:17922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff948944238000 x1875706313346048/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788813271 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813255.874227:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17922:1875706313346048:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788813255.874278:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17922:1875706313346176:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788813255.874301:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813255.874323:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6104f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.874422:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313346176 00000100:00100000:2.0:1788813255.874427:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313346176 00000100:00100000:2.0:1788813255.874451:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813255.874457:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17922:x1875706313346176:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788813255.874515:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17922:x1875706313346176:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 58us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.874521:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788813255.874584:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17922:1875706313346176:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788813255.874625:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813255.877558:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788813255.877645:0:17922:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788813255.877651:0:17922:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:01000000:2.0:1788813255.878468:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788813255.878533:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788813255.879159:0:17894:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788813255.879172:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788813255.879223:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813255.880665:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788813255.881466:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788813255.881515:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788813255.881746:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788813255.882590:0:17894:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:2.0:1788813255.884388:0:17894:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788813255.891588:0:17894:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788813255.891797:0:17894:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb26505553988 00100000:10000000:2.0:1788813255.891806:0:17894:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788813255.892895:0:17894:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788813255.892925:0:17894:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788813255.892976:0:17894:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788813255.892997:0:17894:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788813255.893822:0:17894:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788813255.894108:0:17894:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788813256.100143:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813256.484132:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00000040:00080000:1.0:1788813256.875405:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788813257.124118:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788813257.253145:0:17160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788813257.253152:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a7b569800 from 8 10000000:01000000:0.0:1788813257.253157:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788813257.253202:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40030800/0xf32533d6ff703cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813257.253214:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a40030800/0xf32533d6ff703cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813257.253233:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a40030800/0xf32533d6ff703cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813257.253257:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313346304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813257.253320:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813257.253369:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643a3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813257.253427:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313346304 00000100:00100000:1.0:1788813257.253434:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313346304 00000100:00100000:1.0:1788813257.253483:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788813257.253491:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+16:17160:x1875706313346304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813257.253504:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813257.253515:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a43dad000/0xf32533d6ff703cf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703cef expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813257.253536:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a43dad000/0xf32533d6ff703cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703cef expref: 17 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813257.253547:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a43dad000/0xf32533d6ff703cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703cef expref: 17 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813257.253560:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dad000, rc 0) 00000100:00100000:1.0:1788813257.253597:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+17:17160:x1875706313346304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813257.253603:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788813257.253645:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313346304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813257.253657:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a40030800/0xf32533d6ff703cef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703cf6 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813257.253666:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a40030800/0xf32533d6ff703cef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703cf6 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813257.253708:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313346432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788813257.253733:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813257.253745:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45838a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813257.253756:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313346432 00000100:00100000:1.0:1788813257.253759:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313346432 00000100:00100000:1.0:1788813257.253778:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788813257.253783:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+17:17160:x1875706313346432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788813257.253795:0:17157:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788813257.253810:0:17157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788813257.253812:0:17157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788813257.253870:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+17:17160:x1875706313346432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 87us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813257.253877:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788813257.253903:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313346432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788813257.253964:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788813257.253970:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a40030800/0xf32533d6ff703cef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703cf6 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813257.253979:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a40030800/0xf32533d6ff703cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703cf6 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813257.253987:0:17160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788813257.253988:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9489437db000 from 8 10000000:01000000:1.0:1788813257.253990:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788813257.254003:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703cfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813257.254009:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703cfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813257.254017:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703cfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813257.254026:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313346560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813257.254046:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813257.254070:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45838a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813257.254080:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313346560 00000100:00100000:1.0:1788813257.254083:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313346560 00000100:00100000:1.0:1788813257.254100:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788813257.254105:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+17:17160:x1875706313346560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813257.254111:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813257.254117:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a43dad400/0xf32533d6ff703d04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703cfd expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813257.254138:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a43dad400/0xf32533d6ff703d04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703cfd expref: 18 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813257.254146:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a43dad400/0xf32533d6ff703d04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703cfd expref: 18 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813257.254153:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dad400, rc 0) 00000100:00100000:1.0:1788813257.254175:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17160:x1875706313346560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813257.254180:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788813257.254205:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313346560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813257.254213:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703cfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d04 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813257.254221:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703cfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703d04 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813257.254249:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313346688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788813257.254270:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813257.254280:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45838a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813257.254290:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313346688 00000100:00100000:1.0:1788813257.254292:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313346688 00000100:00100000:1.0:1788813257.254308:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788813257.254313:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17160:x1875706313346688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788813257.254320:0:17157:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788813257.254328:0:17157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788813257.254333:0:17157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788813257.254377:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:17160:x1875706313346688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 64us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813257.254383:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788813257.254407:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313346688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788813257.254431:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788813257.254436:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703cfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d04 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813257.254443:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703cfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d04 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813257.509002:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00000040:00080000:1.0:1788813257.899671:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788813258.148276:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813258.533006:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788813259.181951:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813259.560078:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00010000:00010000:0.0:1788813260.196102:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788813260.286470:0:18165:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788813260.583519:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 0 seconds 00000100:00080000:0.0:1788813261.156072:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788813261.156080:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788813261.156083:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a44ca1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813261.156101:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948a44ca1000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813261.156126:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94894423b480 x1875706313346944/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813261.156141:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813261.156145:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813261.156148:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813261.156151:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813261.156178:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813261.156181:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813261.156183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813261.156186:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788813261.156238:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313347200:0@lo:400:kworker.0 00000100:00100000:0.0:1788813261.156307:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813261.156369:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813261.156376:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313347072:0@lo:400:kworker.0 00000100:00100000:0.0:1788813261.156402:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813261.156452:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313347072 00000100:00100000:0.0:1788813261.156460:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313347072 00000100:00100000:0.0:1788813261.156513:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813261.156522:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313347072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813261.156579:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313347072:12345-0@lo:400:kworker.0 Request processed in 57us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813261.156586:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788813261.156632:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948944239500 x1875706313347072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813261.156644:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313347072:0@lo:400:kworker.0 00000100:00100000:1.0:1788813261.156724:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313346816:0@lo:400:kworker.0 00000100:00100000:1.0:1788813261.156756:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813261.156788:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813261.156793:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313347328:0@lo:400:kworker.0 00000100:00100000:1.0:1788813261.156816:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813261.156852:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313347328 00000100:00100000:1.0:1788813261.156857:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313347328 00000100:00100000:1.0:1788813261.156886:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813261.156892:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313347328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813261.156928:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313347328:12345-0@lo:400:kworker.0 Request processed in 36us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813261.156952:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788813261.156981:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948944238e00 x1875706313347328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813261.157004:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313347328:0@lo:400:kworker.0 00000100:00100000:1.0:1788813261.157029:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313347456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813261.157055:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813261.157087:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313347200 00000100:00100000:1.0:1788813261.157091:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313347200 00000100:00100000:1.0:1788813261.157112:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313347456 00000100:00100000:1.0:1788813261.157116:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313347456 00000100:00100000:1.0:1788813261.157127:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813261.157133:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3628:x1875706313347200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813261.157169:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3628:x1875706313347200:12345-0@lo:400:kworker.0 Request processed in 37us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813261.157175:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813261.157186:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813261.157191:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313347456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788813261.157214:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788813261.157247:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313347456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813261.157253:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813261.157287:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313347456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813261.157311:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313347200:0@lo:400:kworker.0 00000100:00100000:2.0:1788813261.158888:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313346944:0@lo:38:kworker.0 00000100:00100000:2.0:1788813261.158962:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813261.159010:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313346944 00000100:00100000:2.0:1788813261.159016:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313346944 00000100:00100000:2.0:1788813261.159057:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813261.159063:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3624:x1875706313346944:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788813261.159091:0:17902:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:2.0:1788813261.159125:0:17902:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff703d0b 00000004:00100000:2.0:1788813261.159140:0:17902:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788813261.159145:0:17902:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788813261.159380:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313346816 00000100:00100000:0.0:1788813261.159386:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313346816 00000100:00100000:0.0:1788813261.159421:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788813261.159427:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:3626:x1875706313346816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813261.159475:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:3626:x1875706313346816:12345-0@lo:400:kworker.0 Request processed in 48us (2718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813261.159481:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788813261.159526:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313346816:0@lo:400:kworker.0 00000100:00080000:2.0:1788813261.169616:0:17902:0:(import.c:65:import_set_state_nolock()) ffff948a6aec6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813261.169722:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3624:x1875706313346944:12345-0@lo:38:kworker.0 Request processed in 10656us (10757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813261.169733:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788813261.169846:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788813261.169857:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788813261.169871:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788813261.169874:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a44ca1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788813261.169887:0:3624:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000006cc199): req@ffff94894424df80 x1875706313340032/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813261.169912:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313346944:0@lo:38:kworker.0 00000100:00100000:0.0:1788813261.170048:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813261.170062:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313347584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813261.170105:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813261.170324:0:17204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813261.170349:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948941082a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813261.170365:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313347584 00000100:00100000:2.0:1788813261.170371:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313347584 00000100:00100000:2.0:1788813261.170403:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313340032 00000100:00100000:2.0:1788813261.170407:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313340032 00000100:00100000:2.0:1788813261.170420:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813261.170428:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3628:x1875706313347584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813261.170456:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788813261.170495:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3628:x1875706313347584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813261.170501:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813261.170519:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313347584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813261.170521:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788813261.170527:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17204:x1875706313340032:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788813261.170596:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17204:x1875706313340032:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 69us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813261.170603:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813261.170732:0:17204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424df80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17204:1875706313340032:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788813261.170765:0:17204:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788813261.170807:0:17204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17204:1875706313347712:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788813261.170842:0:17204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813261.170882:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6104f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813261.173036:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313347712 00000100:00100000:2.0:1788813261.173048:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313347712 00000100:00100000:2.0:1788813261.173105:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788813261.173116:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17204:x1875706313347712:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788813261.173295:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17204:x1875706313347712:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 180us (2451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813261.173302:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788813261.173346:0:17204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17204:1875706313347712:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788813261.173438:0:17204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17204:1875706313347840:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788813261.173469:0:17204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813261.173491:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813261.173506:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313347840 00000100:00100000:2.0:1788813261.173509:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313347840 00000100:00100000:2.0:1788813261.173531:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788813261.173537:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17204:x1875706313347840:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788813261.173585:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17204:x1875706313347840:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 48us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813261.173591:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788813261.173614:0:17204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17204:1875706313347840:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788813261.173657:0:17204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813261.178889:0:17204:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788813261.179018:0:17204:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:2.0:1788813261.184244:0:17204:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788813261.221413:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788813261.316653:0:18217:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788813261.316835:0:18217:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1788813262.135164:0:18267:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813262.135479:0:18267:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788813262.249886:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788813263.229566:0:18315:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7d503530 20000000:00000080:1.0:1788813263.229584:0:18315:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff948a44772400 uarg=0000000000000000 20000000:01000000:1.0:1788813263.229623:0:18315:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788813263.229630:0:18315:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788813263.229634:0:18315:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788813263.231207:0:18316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788813263.234091:0:18315:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788813263.253635:0:18315:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788813263.253853:0:18315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a6fc09000/0xf32533d6ff703d12 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.253874:0:18315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a40031200/0xf32533d6ff703bbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703bb4 expref: 17 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.253880:0:18315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703cbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703cb7 expref: 17 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.253886:0:18315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948a6fc09000/0xf32533d6ff703d12 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.253955:0:18315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703cbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff703cb7 expref: 17 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.253971:0:18315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703cbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff703cb7 expref: 17 pid: 17157 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813263.253986:0:18315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18315:1875706313347968:0@lo:104: 00000100:00100000:2.0:1788813263.254057:0:18315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813263.254108:0:18315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a40031200/0xf32533d6ff703bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff703bb4 expref: 17 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.254116:0:18315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a40031200/0xf32533d6ff703bbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff703bb4 expref: 17 pid: 17157 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813263.254124:0:18315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18315:1875706313348096:0@lo:104: 00000100:00100000:2.0:1788813263.254144:0:18315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813263.254172:0:18315:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6eccea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813263.254319:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313347968 00000100:00100000:0.0:1788813263.254327:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313347968 00000100:00100000:0.0:1788813263.254363:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313348096 00000100:00100000:0.0:1788813263.254366:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313348096 00000100:00100000:0.0:1788813263.254393:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813263.254403:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7e65740-fccd-471b-95df-6f83776cc95f+4:18315:x1875706313347968:12345-0@lo:104: 00010000:00010000:0.0:1788813263.254416:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a40030400/0xf32533d6ff703cb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703cbe expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813263.254478:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788813263.254484:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7e65740-fccd-471b-95df-6f83776cc95f+4:18315:x1875706313347968:12345-0@lo:104: Request processed in 83us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813263.254490:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788813263.254507:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788813263.254508:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788813263.254513:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a40030400/0xf32533d6ff703cb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703cbe expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813263.254514:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7e65740-fccd-471b-95df-6f83776cc95f+3:18315:x1875706313348096:12345-0@lo:104: 00010000:00010000:3.0:1788813263.254521:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40030400 already unused, calling callback (ffffffffc13c1c20) 00010000:00010000:0.0:1788813263.254521:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff703bb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703bbb expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813263.254525:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a40030400/0xf32533d6ff703cb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff703cbe expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813263.254545:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a40030400/0xf32533d6ff703cb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff703cbe expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813263.254553:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a40030400/0xf32533d6ff703cb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff703cbe expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813263.254559:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788813263.254559:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788813263.254564:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7e65740-fccd-471b-95df-6f83776cc95f+3:18315:x1875706313348096:12345-0@lo:104: Request processed in 51us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813263.254569:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788813263.254586:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a40030400/0xf32533d6ff703cb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703cbe expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813263.254592:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813263.254623:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a40030400/0xf32533d6ff703cb7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703cbe expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813263.254631:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a40030400/0xf32533d6ff703cb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703cbe expref: -99 pid: 17894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813263.254649:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813263.254653:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff703bb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703bbb expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813263.254658:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09e00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:3.0:1788813263.254661:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff703bb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff703bbb expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813263.254668:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff703bb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff703bbb expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813263.254674:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff703bb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff703bbb expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813263.254678:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788813263.254685:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788813263.254785:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313348224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813263.254795:0:18315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18315:1875706313347968:0@lo:104: 00000100:00100000:2.0:1788813263.254804:0:18315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18315:1875706313348096:0@lo:104: 00000100:00100000:0.0:1788813263.254812:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813263.254823:0:18315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948a6fc09000/0xf32533d6ff703d12 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813263.254845:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313348224 00000100:00100000:0.0:1788813263.254855:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313348224 00010000:00010000:0.0:1788813263.254872:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703cbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703cb7 expref: 18 pid: 17157 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813263.254901:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813263.254908:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7e65740-fccd-471b-95df-6f83776cc95f+18:3628:x1875706313348224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813263.254918:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813263.254922:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703cbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703cb7 expref: 18 pid: 17157 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813263.254952:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703cbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff703cb7 expref: 18 pid: 17157 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813263.255045:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703cbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff703cb7 expref: 18 pid: 17157 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813263.255057:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813263.255086:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7e65740-fccd-471b-95df-6f83776cc95f+17:3628:x1875706313348224:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813263.255092:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813263.255115:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313348224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813263.255173:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff703bb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703bbb expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813263.255180:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788813263.255218:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313348352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813263.255242:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813263.255287:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff703bb4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703bbb expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813263.255295:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a6fc09e00/0xf32533d6ff703bb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703bbb expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813263.255308:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813263.255309:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813263.255311:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813263.255316:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313348352 00000100:00100000:2.0:1788813263.255320:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313348352 00010000:00010000:2.0:1788813263.255334:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a40031200/0xf32533d6ff703bbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703bb4 expref: 17 pid: 17157 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813263.255362:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788813263.255369:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7e65740-fccd-471b-95df-6f83776cc95f+17:3625:x1875706313348352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813263.255388:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813263.255392:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a40031200/0xf32533d6ff703bbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703bb4 expref: 17 pid: 17157 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.255401:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a40031200/0xf32533d6ff703bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff703bb4 expref: 17 pid: 17157 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.255412:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a40031200/0xf32533d6ff703bbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff703bb4 expref: 17 pid: 17157 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.255422:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948a6fc09000/0xf32533d6ff703d12 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.255431:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc09000/0xf32533d6ff703d12 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.255442:0:17148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a6fc09000/0xf32533d6ff703d12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.255454:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a6fc09000/0xf32533d6ff703d12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.255460:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a6fc09000/0xf32533d6ff703d12 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.255466:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a6fc09000/0xf32533d6ff703d12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.255472:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813263.255476:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a6fc09000/0xf32533d6ff703d12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.255482:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a6fc09000/0xf32533d6ff703d12 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.255495:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a6fc09000/0xf32533d6ff703d12 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813263.255504:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813263.262106:0:18315:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948a6fc09000/0xf32533d6ff703d12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813263.262124:0:18315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a6fc09000/0xf32533d6ff703d12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813263.262130:0:18315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc09000/0xf32533d6ff703d12 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813263.262824:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7e65740-fccd-471b-95df-6f83776cc95f+16:3625:x1875706313348352:12345-0@lo:103:ldlm_bl.0 Request processed in 7448us (7573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813263.262835:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788813263.265169:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313348352:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813263.269894:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813264.292315:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788813265.060110:0:17160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788813265.060118:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a7b569800 from 13 10000000:01000000:0.0:1788813265.060124:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813265.060175:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff703d19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813265.060186:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff703d19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813265.060198:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff703d19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813265.060223:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313348480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813265.060292:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813265.060342:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a46774d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813265.060392:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313348480 00000100:00100000:1.0:1788813265.060402:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313348480 00000100:00100000:1.0:1788813265.060457:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788813265.060467:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+16:17160:x1875706313348480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813265.060479:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813265.060491:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a43dacc00/0xf32533d6ff703d20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703d19 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813265.060515:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a43dacc00/0xf32533d6ff703d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703d19 expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813265.060525:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a43dacc00/0xf32533d6ff703d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703d19 expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813265.060535:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dacc00, rc 0) 00000100:00100000:1.0:1788813265.060580:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+17:17160:x1875706313348480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813265.060587:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788813265.060634:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313348480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813265.060657:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff703d19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d20 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813265.060666:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff703d19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703d20 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813265.060730:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313348608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813265.060754:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813265.060769:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a608fe3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813265.060783:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313348608 00000100:00100000:1.0:1788813265.060788:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313348608 00000100:00100000:1.0:1788813265.060811:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788813265.060818:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+17:17160:x1875706313348608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813265.060925:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+17:17160:x1875706313348608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813265.060959:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788813265.061001:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313348608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813265.061030:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313348736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813265.061067:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813265.061086:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a74a47a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813265.061097:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313348736 00000100:00100000:1.0:1788813265.061101:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313348736 00000100:00100000:1.0:1788813265.061123:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788813265.061130:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+17:17160:x1875706313348736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813265.061206:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+17:17160:x1875706313348736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813265.061222:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788813265.061260:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313348736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788813265.061879:0:18408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788813265.061964:0:17160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788813265.061980:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813265.062000:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff703d19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d20 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813265.062010:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff703d19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d20 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813265.062019:0:17160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813265.062022:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9489437db000 from 13 10000000:01000000:1.0:1788813265.062024:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813265.062048:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dad800/0xf32533d6ff703d27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813265.062055:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a43dad800/0xf32533d6ff703d27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813265.062064:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a43dad800/0xf32533d6ff703d27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813265.062079:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313348864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813265.062113:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813265.062139:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a74a47480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813265.062152:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313348864 00000100:00100000:1.0:1788813265.062156:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313348864 00000100:00100000:1.0:1788813265.062195:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788813265.062201:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+17:17160:x1875706313348864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813265.062210:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813265.062220:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a43dac200/0xf32533d6ff703d2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703d27 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813265.062236:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a43dac200/0xf32533d6ff703d2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703d27 expref: 18 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813265.062245:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a43dac200/0xf32533d6ff703d2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703d27 expref: 18 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813265.062252:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac200, rc 0) 00000100:00100000:1.0:1788813265.062284:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+18:17160:x1875706313348864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813265.062290:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788813265.062324:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313348864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813265.062335:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a43dad800/0xf32533d6ff703d27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d2e expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813265.062342:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a43dad800/0xf32533d6ff703d27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703d2e expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813265.062381:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313348992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813265.062404:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813265.062416:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a74a47480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813265.062426:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313348992 00000100:00100000:1.0:1788813265.062429:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313348992 00000100:00100000:1.0:1788813265.062455:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788813265.062460:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+18:17160:x1875706313348992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813265.062532:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+18:17160:x1875706313348992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813265.062539:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788813265.062565:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313348992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813265.062590:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313349120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813265.062622:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813265.062633:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a74a47480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813265.062643:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313349120 00000100:00100000:1.0:1788813265.062646:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313349120 00000100:00100000:1.0:1788813265.062665:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788813265.062671:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+18:17160:x1875706313349120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813265.062735:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+18:17160:x1875706313349120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813265.062741:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788813265.062778:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313349120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788813265.073720:0:18409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788813265.074118:0:17160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788813265.074144:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813265.074157:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dad800/0xf32533d6ff703d27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d2e expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813265.074170:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a43dad800/0xf32533d6ff703d27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d2e expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813265.253745:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813255/real 1788813255] req@ffff94894424f480 x1875706313343232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813265 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813265.253773:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94894424f480 x1875706313343232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813265 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813265.253795:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813255/real 1788813255] req@ffff9489433a6d80 x1875706313343104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813265 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813265.253807:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9489433a6d80 x1875706313343104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813265 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788813265.253824:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b790000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813265.253849:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788813265.253852:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313343232:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788813265.253858:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a611ac800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813265.253863:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788813265.253866:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313343104:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788813265.253994:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813265.253998:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813265.254001:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813265.254004:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813265.254035:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813265.254038:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788813265.254040:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a611ac800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813265.254045:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 408 00000100:00080000:0.0:1788813265.254050:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788813265.254059:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff948a611ac800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813265.254077:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948944238000 x1875706313349632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813265.254087:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813265.254096:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788813265.254097:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a7b790000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813265.254100:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 408 00000100:00080000:0.0:1788813265.254103:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788813265.254107:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff948a7b790000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813265.254119:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948944239c00 x1875706313349760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813265.254150:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313349888:0@lo:400:kworker.0 00000100:00100000:0.0:1788813265.254207:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813265.254234:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813265.254239:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313349248:0@lo:400:kworker.0 00000100:00100000:0.0:1788813265.254260:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813265.254286:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313349504:0@lo:400:kworker.0 00000100:00100000:0.0:1788813265.254306:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813265.254323:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813265.254328:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313349376:0@lo:400:kworker.0 00000100:00100000:0.0:1788813265.254345:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813265.254368:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313349888 00000100:00100000:0.0:1788813265.254375:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313349888 00000100:00100000:0.0:1788813265.254409:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313349376 00000100:00100000:0.0:1788813265.254411:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313349376 00000100:00100000:0.0:1788813265.254425:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788813265.254431:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313349888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813265.254476:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313349888:12345-0@lo:400:kworker.0 Request processed in 44us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813265.254482:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788813265.254504:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813265.254509:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313349376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813265.254537:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313349376:12345-0@lo:400:kworker.0 Request processed in 28us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813265.254542:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813265.254557:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313349248 00000100:00100000:0.0:1788813265.254560:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313349248 00000100:00100000:0.0:1788813265.254578:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313349504 00000100:00100000:0.0:1788813265.254580:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313349504 00000100:00100000:0.0:1788813265.254607:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788813265.254612:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1875706313349248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813265.254639:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1875706313349248:12345-0@lo:400:kworker.0 Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813265.254644:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788813265.254654:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788813265.254659:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313349504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813265.254682:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313349504:12345-0@lo:400:kworker.0 Request processed in 23us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813265.254686:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788813265.254724:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94894423b100 x1875706313349376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813265.254735:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313349376:0@lo:400:kworker.0 00000100:00100000:0.0:1788813265.254744:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313349504:0@lo:400:kworker.0 00000100:00100000:0.0:1788813265.254765:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313349248:0@lo:400:kworker.0 00010000:00080000:0.0:1788813265.254775:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94894423aa00 x1875706313349888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813265.254790:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313349888:0@lo:400:kworker.0 00000100:00100000:2.0:1788813265.254956:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313349632:0@lo:8:kworker.0 00000400:00000100:2.0:1788813265.254977:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313349632 offset 0 length 520: 4 00000100:00100000:2.0:1788813265.255009:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313349760:0@lo:8:kworker.0 00000400:00000100:2.0:1788813265.255025:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313349760 offset 0 length 520: 4 00010000:00010000:3.0:1788813265.317158:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813265.703603:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788813266.276115:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813266.276164:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313350016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813266.276233:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813266.276287:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313350016 00000100:00100000:1.0:1788813266.276295:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313350016 00000100:00100000:1.0:1788813266.276338:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788813266.276346:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313350016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788813266.276380:0:17902:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788813266.276424:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313350016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813266.276430:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788813266.276473:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313350016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813266.276688:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813266.276698:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313350144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813266.276725:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813266.279888:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313350144 00000100:00100000:2.0:1788813266.279904:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313350144 00000100:00100000:2.0:1788813266.280014:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788813266.280026:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313350144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813266.280065:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788813266.280154:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313350144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (3427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813266.280163:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813266.280627:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313350144:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788813266.341144:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788813266.801630:0:17895:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:1.0:1788813267.109561:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788813267.364839:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813268.324775:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813253/real 1788813253] req@ffff9489433a6a00 x1875706313341056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813268 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813268.324811:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9489433a6a00 x1875706313341056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813268 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813268.324821:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813253/real 1788813253] req@ffff9489433a4e00 x1875706313341184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813268 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813268.324832:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9489433a4e00 x1875706313341184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813268 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788813268.324850:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a611ab800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788813268.324875:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788813268.324881:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313341056:0@lo:8:kworker.0 00000100:00080000:1.0:1788813268.324886:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a507c3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788813268.324921:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788813268.324925:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313341184:0@lo:8:kworker.0 00000100:00100000:3.0:1788813268.325057:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313350272:0@lo:400:kworker.0 00000100:00100000:3.0:1788813268.325111:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788813268.325318:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813268.325323:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788813268.325342:0:8:0:(import.c:65:import_set_state_nolock()) ffff948a611ab800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813268.325347:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 406 00000100:00080000:3.0:1788813268.325352:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788813268.325362:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff948a611ab800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813268.325385:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94894424f100 x1875706313350528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813268.325400:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813268.325404:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788813268.325406:0:8:0:(import.c:65:import_set_state_nolock()) ffff948a507c3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813268.325409:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 406 00000100:00080000:3.0:1788813268.325412:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788813268.325416:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948a507c3800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813268.325427:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94894424ea00 x1875706313350656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813268.325452:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813268.325455:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813268.325458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813268.325461:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813268.325476:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813268.325478:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813268.325480:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813268.325483:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788813268.325497:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313350784:0@lo:400:kworker.0 00000100:00100000:3.0:1788813268.325540:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813268.325574:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813268.325581:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313350400:0@lo:400:kworker.0 00000100:00100000:3.0:1788813268.325606:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813268.325645:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313350784 00000100:00100000:3.0:1788813268.325668:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313350784 00000100:00100000:3.0:1788813268.325709:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813268.325715:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313350784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813268.325751:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313350784:12345-0@lo:400:kworker.0 Request processed in 37us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813268.325756:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813268.325772:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313350400 00000100:00100000:3.0:1788813268.325775:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313350400 00000100:00100000:3.0:1788813268.325788:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813268.325792:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313350400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813268.325810:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313350400:12345-0@lo:400:kworker.0 Request processed in 19us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813268.325814:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813268.325837:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313350400:0@lo:400:kworker.0 00010000:00080000:3.0:1788813268.325844:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94894424c700 x1875706313350784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813268.325850:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313350784:0@lo:400:kworker.0 00000100:00100000:3.0:1788813268.325863:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313351040:0@lo:400:kworker.0 00000100:00100000:3.0:1788813268.325878:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813268.325889:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813268.325899:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313350912:0@lo:400:kworker.0 00000100:00100000:3.0:1788813268.325912:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813268.325990:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313351040 00000100:00100000:3.0:1788813268.325994:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313351040 00000100:00100000:3.0:1788813268.326013:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813268.326017:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313351040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813268.326051:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313351040:12345-0@lo:400:kworker.0 Request processed in 34us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813268.326055:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788813268.326073:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94894424ce00 x1875706313351040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813268.326079:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313351040:0@lo:400:kworker.0 00000100:00100000:0.0:1788813268.326238:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313350528:0@lo:8:kworker.0 00000400:00000100:0.0:1788813268.326265:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313350528 offset 0 length 520: 4 00000100:00100000:0.0:1788813268.326288:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313350656:0@lo:8:kworker.0 00000400:00000100:0.0:1788813268.326303:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706313350656 offset 0 length 520: 4 00000100:00100000:2.0:1788813268.326792:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313350912 00000100:00100000:2.0:1788813268.326797:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313350912 00000100:00100000:2.0:1788813268.326837:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788813268.326844:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313350912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813268.326900:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313350912:12345-0@lo:400:kworker.0 Request processed in 56us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813268.326906:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788813268.326994:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313350912:0@lo:400:kworker.0 00000100:00100000:1.0:1788813268.330040:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313350272 00000100:00100000:1.0:1788813268.330059:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313350272 00000100:00100000:0.0:1788813268.330216:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788813268.330228:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+18:3628:x1875706313350272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813268.330323:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+18:3628:x1875706313350272:12345-0@lo:400:kworker.0 Request processed in 97us (5210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813268.330340:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788813268.330361:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313350272:0@lo:400:kworker.0 00010000:00010000:0.0:1788813268.394098:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813269.412138:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788813269.666422:0:18664:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788813269.666426:0:18664:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788813269.666428:0:18664:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788813269.666536:0:18664:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff948943443000 00000020:01000004:3.0:1788813269.666549:0:18664:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788813269.666563:0:18664:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788813269.666576:0:18664:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff948a6adb0000) 00000020:00000080:3.0:1788813269.666591:0:18664:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788813269.736601:0:18664:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788813269.738012:0:18664:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788813269.738309:0:18664:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788813269.738778:0:18664:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788813269.739033:0:18664:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788813269.739551:0:18664:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788813269.739795:0:18664:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1788813269.746715:0:18664:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788813269.747256:0:18664:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788813269.747271:0:18664:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788813269.747284:0:18664:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf32533d6ff703d3c 00000020:01000004:2.0:1788813269.747291:0:18664:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788813269.747312:0:18664:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.113@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788813269.747316:0:18664:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788813269.747322:0:18664:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788813269.747327:0:18664:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788813269.747351:0:18664:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff948a44763380) 00000020:00000080:2.0:1788813269.747364:0:18664:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788813269.750678:0:18664:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813269.750861:0:18664:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788813269.750868:0:18664:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788813269.756846:0:18664:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788813269.756860:0:18664:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788813269.757879:0:18664:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788813269.757888:0:18664:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788813269.759640:0:18664:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788813269.761450:0:18664:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788813269.761458:0:18664:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788813269.769964:0:18664:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788813269.769983:0:18664:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788813269.806296:0:18664:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813269.806527:0:18664:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788813269.806534:0:18664:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788813269.814132:0:18664:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788813269.814153:0:18664:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788813269.815373:0:18664:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788813269.815383:0:18664:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788813269.817046:0:18664:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813269.817244:0:18664:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788813269.817250:0:18664:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788813269.818116:0:18664:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788813269.818124:0:18664:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788813269.851339:0:18664:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813269.851544:0:18664:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788813269.851550:0:18664:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788813269.858242:0:18664:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788813269.858258:0:18664:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788813269.859664:0:18664:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788813269.859695:0:18664:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788813269.859702:0:18664:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788813269.880719:0:18664:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788813269.880766:0:18664:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.113@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788813269.880771:0:18664:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788813269.880772:0:18664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788813269.880774:0:18664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813269.880775:0:18664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813269.880776:0:18664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813269.880778:0:18664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813269.880779:0:18664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813269.880781:0:18664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813269.880782:0:18664:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788813269.880786:0:18664:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788813269.880788:0:18664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788813269.880790:0:18664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788813269.880791:0:18664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813269.880792:0:18664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813269.880793:0:18664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813269.880794:0:18664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813269.880795:0:18664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813269.880796:0:18664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813269.880797:0:18664:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788813269.880825:0:18664:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788813269.880844:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313351168:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788813269.881732:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813269.881782:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a510e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813269.882228:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313351168 00000100:00100000:0.0:1788813269.882240:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313351168 00000100:00100000:0.0:1788813269.882298:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788813269.882307:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943411c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:18664:x1875706313351168:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788813269.882357:0:17157:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788813269.882366:0:17157:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788813269.882370:0:17157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788813269.882868:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943411c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+18:18664:x1875706313351168:12345-0@lo:253:mount.lustre.0 Request processed in 562us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813269.882877:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788813269.883021:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313351168:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788813269.883054:0:18664:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788813269.883058:0:18664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788813269.883059:0:18664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788813269.883060:0:18664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813269.883062:0:18664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813269.883063:0:18664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813269.883064:0:18664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813269.883065:0:18664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813269.883066:0:18664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813269.883067:0:18664:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788813269.883088:0:18664:0:(tgt_mount.c:101:server_register_mount()) register mount ffff948943443000 from lustre-OST0000 10000000:01000000:2.0:1788813269.883117:0:18664:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788813269.883120:0:18664:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788813269.883127:0:18664:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff948942dccd40 local copy 00010000:00010000:2.0:1788813269.883137:0:18664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813269.883234:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313351296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813269.883267:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813269.883302:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45838480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813269.883443:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313351296 00000100:00100000:1.0:1788813269.883448:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313351296 00000100:00100000:1.0:1788813269.883478:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788813269.883486:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943411050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+18:18664:x1875706313351296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813269.883560:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943411050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+18:18664:x1875706313351296:12345-0@lo:501:mount.lustre.0 Request processed in 75us (291us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813269.883566:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788813269.883635:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313351296:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788813269.883650:0:18664:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788813269.883670:0:18664:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788813269.883676:0:18664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813269.883685:0:18664:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813269.883709:0:18664:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff948943443000 10000000:01000000:3.0:1788813269.883715:0:18664:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788813269.883719:0:18664:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788813269.883722:0:18664:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788813269.883725:0:18664:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788813269.883728:0:18664:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788813269.883750:0:18664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813269.883767:0:18664:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813269.883777:0:18664:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813269.883790:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313351424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813269.883817:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813269.883837:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4240 going to sleep for 11 seconds 00000100:00100000:1.0:1788813269.883884:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313351424 00000100:00100000:1.0:1788813269.883889:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313351424 00000100:00100000:1.0:1788813269.883916:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788813269.883922:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+18:18664:x1875706313351424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813269.883974:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813269.883987:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a43dad200/0xf32533d6ff703d51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703d4a expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813269.884008:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a43dad200/0xf32533d6ff703d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703d4a expref: 19 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813269.884018:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a43dad200/0xf32533d6ff703d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703d4a expref: 19 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813269.884027:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dad200, rc 0) 00000100:00100000:1.0:1788813269.884052:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+19:18664:x1875706313351424:12345-0@lo:101:mount.lustre.0 Request processed in 131us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813269.884058:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788813269.884184:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313351424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813269.884196:0:18664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d51 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813269.884206:0:18664:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703d51 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813269.885419:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788813269.886378:0:18664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813269.888447:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788813269.888498:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788813269.888514:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788813269.888528:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788813269.888542:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788813269.888556:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788813269.888581:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788813269.888587:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788813269.888688:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313351552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813269.888759:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813269.888810:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788813269.889119:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313351552 00000100:00100000:1.0:1788813269.889132:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313351552 00000100:00100000:1.0:1788813269.889171:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788813269.889180:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943410850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+19:18664:x1875706313351552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813269.889324:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943410850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+19:18664:x1875706313351552:12345-0@lo:501:mount.lustre.0 Request processed in 145us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813269.889332:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788813269.889514:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313351552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813269.889550:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313351680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813269.889589:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813269.889618:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788813269.889744:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313351680 00000100:00100000:2.0:1788813269.889749:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313351680 00000100:00100000:2.0:1788813269.889784:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788813269.889792:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+19:18664:x1875706313351680:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813269.890521:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+19:18664:x1875706313351680:12345-0@lo:503:mount.lustre.0 Request processed in 727us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813269.890530:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788813269.890661:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313351680:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788813269.892698:0:18664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788813269.892792:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313351808:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813269.892872:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813269.893118:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a488bfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813269.896851:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313351808 00000100:00100000:0.0:1788813269.896869:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313351808 00000100:00100000:0.0:1788813269.896976:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788813269.896987:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+19:18664:x1875706313351808:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813269.899256:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+19:18664:x1875706313351808:12345-0@lo:502:mount.lustre.0 Request processed in 2263us (6375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813269.899269:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788813269.899392:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313351808:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788813269.899626:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788813269.899656:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788813269.899687:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788813269.899704:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788813269.899718:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788813269.899730:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788813269.899740:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788813269.899750:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788813269.899760:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788813269.899771:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788813269.899781:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788813269.899791:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788813269.899827:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313351936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813269.899871:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813269.899920:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4240 going to sleep for 11 seconds 00000100:00100000:1.0:1788813269.900022:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313351936 00000100:00100000:1.0:1788813269.900030:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313351936 00000100:00100000:1.0:1788813269.900076:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788813269.900085:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+19:18664:x1875706313351936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813269.900199:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+19:18664:x1875706313351936:12345-0@lo:502:mount.lustre.0 Request processed in 115us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813269.900206:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788813269.900300:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313351936:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788813269.900342:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788813269.900350:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788813269.901374:0:18681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813269.901384:0:18681:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788813269.901390:0:18681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813269.901393:0:18681:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788813269.901400:0:18681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813269.901415:0:18681:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff948a506e4d40) 00000020:00000080:1.0:1788813269.901442:0:18681:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788813269.901448:0:18681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788813269.901525:0:18681:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948943443000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788813269.901533:0:18681:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788813269.901541:0:18681:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf32533d6ff703d5f 00010000:00010000:1.0:1788813269.910198:0:18681:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788813269.910767:0:18681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788813269.913500:0:18681:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788813269.915558:0:18681:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788813269.915569:0:18681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813269.915582:0:18681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813269.915584:0:18681:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788813269.915588:0:18681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788813269.915591:0:18681:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788813269.915593:0:18681:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813269.915594:0:18681:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813269.915596:0:18681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788813269.915598:0:18681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813269.915600:0:18681:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788813269.915602:0:18681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813269.915605:0:18681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813269.915606:0:18681:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788813269.915610:0:18681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788813269.915611:0:18681:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788813269.915613:0:18681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813269.915616:0:18681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813269.915617:0:18681:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788813269.915619:0:18681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813269.915621:0:18681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813269.915622:0:18681:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788813269.915626:0:18681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788813269.915657:0:18681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813269.915661:0:18681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813269.915662:0:18681:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788813269.915665:0:18681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788813269.921868:0:18664:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788813269.922176:0:18664:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788813269.922249:0:18664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d51 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813269.922263:0:18664:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948943657e00/0xf32533d6ff703d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d51 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813269.922272:0:18664:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948943443000 from 1 10000000:01000000:3.0:1788813269.922275:0:18664:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788813269.922311:0:18664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656200/0xf32533d6ff703d66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813269.922319:0:18664:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948943656200/0xf32533d6ff703d66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813269.922331:0:18664:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948943656200/0xf32533d6ff703d66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813269.922356:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813269.922417:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813269.922459:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813269.925024:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313352064 00000100:00100000:2.0:1788813269.925034:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313352064 00000100:00100000:2.0:1788813269.925092:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788813269.925099:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+19:18664:x1875706313352064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813269.925114:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813269.925129:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703d6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703d66 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.925149:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703d66 expref: 20 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.925167:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703d66 expref: 20 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.925174:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09800, rc 0) 00000100:00100000:2.0:1788813269.925227:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+20:18664:x1875706313352064:12345-0@lo:101:mount.lustre.0 Request processed in 128us (2810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813269.925231:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788813269.925756:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813269.925770:0:18664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948943656200/0xf32533d6ff703d66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d6d expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813269.925777:0:18664:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948943656200/0xf32533d6ff703d66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703d6d expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813269.926611:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788813269.926863:0:18664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813269.927084:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788813269.927106:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788813269.927122:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788813269.927127:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788813269.927184:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813269.927231:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813269.927272:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788813269.927472:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313352192 00000100:00100000:2.0:1788813269.927478:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313352192 00000100:00100000:2.0:1788813269.927521:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788813269.927530:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+20:18664:x1875706313352192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813269.927627:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+20:18664:x1875706313352192:12345-0@lo:501:mount.lustre.0 Request processed in 98us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813269.927636:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788813269.927702:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813269.927727:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813269.927774:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813269.927797:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788813269.927883:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313352320 00000100:00100000:2.0:1788813269.927888:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313352320 00000100:00100000:2.0:1788813269.927915:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788813269.927921:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+20:18664:x1875706313352320:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813269.928032:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+20:18664:x1875706313352320:12345-0@lo:503:mount.lustre.0 Request processed in 110us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813269.928053:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788813269.928129:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352320:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788813269.928725:0:18664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813269.928770:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46544700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813269.928799:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813269.928822:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a642b89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813269.928842:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313352448 00000100:00100000:3.0:1788813269.928847:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313352448 00000100:00100000:3.0:1788813269.928918:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788813269.928926:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+20:18664:x1875706313352448:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813269.929048:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+20:18664:x1875706313352448:12345-0@lo:502:mount.lustre.0 Request processed in 114us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813269.929055:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788813269.929146:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46544700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813269.929506:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788813269.929531:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788813269.929544:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788813269.929556:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788813269.929569:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788813269.929580:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788813269.929587:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788813269.929593:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788813269.929600:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788813269.929607:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788813269.929622:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788813269.929636:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46544700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813269.929663:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813269.929682:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a642b89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813269.929699:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313352576 00000100:00100000:2.0:1788813269.929705:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313352576 00000100:00100000:2.0:1788813269.929765:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788813269.929771:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+20:18664:x1875706313352576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813269.929837:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+20:18664:x1875706313352576:12345-0@lo:502:mount.lustre.0 Request processed in 66us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813269.929845:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788813269.929857:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46544700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813269.929895:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788813269.929912:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788813269.931031:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813269.931112:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813269.931115:0:18685:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788813269.931121:0:18685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948943443000 00000020:00000080:0.0:1788813269.931123:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813269.931129:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813269.931131:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813269.931132:0:18685:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788813269.931133:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813269.931135:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813269.931136:0:18685:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788813269.931138:0:18685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948943443000 00000020:00000080:0.0:1788813269.931139:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813269.931184:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813269.931186:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813269.931186:0:18685:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788813269.931188:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813269.931189:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813269.931190:0:18685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788813269.931192:0:18685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948943443000 00000020:00000080:0.0:1788813269.931193:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813269.931203:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813269.931205:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813269.931206:0:18685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788813269.931207:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813269.931214:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813269.931215:0:18685:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788813269.931217:0:18685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948943443000 00000020:00000080:0.0:1788813269.931218:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813269.931232:0:18685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813269.931234:0:18685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813269.931234:0:18685:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788813269.931237:0:18685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788813269.937287:0:18664:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788813269.937334:0:18664:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788813269.937352:0:18664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656200/0xf32533d6ff703d66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d6d expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813269.937366:0:18664:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948943656200/0xf32533d6ff703d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d6d expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813269.937418:0:18664:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788813269.937421:0:18664:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff948943443000 10000000:01000000:3.0:1788813269.937430:0:18664:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff948943443000 10000000:01000000:3.0:1788813269.937434:0:18664:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788813269.937440:0:18664:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948943443000 from 1 10000000:01000000:3.0:1788813269.937443:0:18664:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788813269.937477:0:18664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813269.937486:0:18664:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813269.937497:0:18664:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813269.937519:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813269.937579:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813269.937620:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313352704 00000100:00100000:3.0:1788813269.937624:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489435a49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813269.937627:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313352704 00000100:00100000:0.0:1788813269.937727:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788813269.937734:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+20:18664:x1875706313352704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813269.937744:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813269.937754:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cdb600/0xf32533d6ff703d7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703d74 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813269.937772:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdb600/0xf32533d6ff703d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703d74 expref: 21 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813269.937779:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cdb600/0xf32533d6ff703d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703d74 expref: 21 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813269.937785:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdb600, rc 0) 00000100:00100000:0.0:1788813269.937818:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+21:18664:x1875706313352704:12345-0@lo:101:mount.lustre.0 Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813269.937824:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788813269.938159:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813269.938173:0:18664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d7b expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813269.938182:0:18664:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703d7b expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813269.943024:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788813269.943331:0:18664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813269.943539:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788813269.943571:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788813269.943590:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788813269.943608:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788813269.943628:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788813269.943645:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788813269.943662:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788813269.943679:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788813269.943695:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788813269.943709:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788813269.943723:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788813269.943740:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788813269.945051:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788813269.945079:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788813269.945094:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788813269.945106:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788813269.945138:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788813269.945165:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788813269.945180:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788813269.945194:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788813269.945206:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788813269.945219:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788813269.945231:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788813269.945244:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788813269.945256:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788813269.945271:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788813269.945285:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788813269.945298:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788813269.945309:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788813269.945321:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788813269.945334:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788813269.945350:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788813269.945377:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788813269.945393:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788813269.945408:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788813269.945426:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788813269.945442:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788813269.945469:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788813269.945474:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788813269.945574:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813269.945642:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813269.945687:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788813269.945713:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313352832 00000100:00100000:2.0:1788813269.945720:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313352832 00000100:00100000:2.0:1788813269.946902:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788813269.946923:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+21:18664:x1875706313352832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813269.947334:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+21:18664:x1875706313352832:12345-0@lo:501:mount.lustre.0 Request processed in 421us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813269.947353:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788813269.947414:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813269.947456:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352960:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813269.947500:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813269.947583:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813269.953664:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313352960 00000100:00100000:0.0:1788813269.953681:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313352960 00000100:00100000:0.0:1788813269.953735:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788813269.953757:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+21:18664:x1875706313352960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813269.953965:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+21:18664:x1875706313352960:12345-0@lo:503:mount.lustre.0 Request processed in 221us (6464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813269.953973:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788813269.954156:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313352960:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788813269.954572:0:18664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788813269.954655:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313353088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813269.954698:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813269.954739:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813269.954872:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313353088 00000100:00100000:0.0:1788813269.954877:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313353088 00000100:00100000:0.0:1788813269.954915:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788813269.954923:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+21:18664:x1875706313353088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813269.955044:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+21:18664:x1875706313353088:12345-0@lo:502:mount.lustre.0 Request processed in 122us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813269.955051:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788813269.955142:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313353088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788813269.955311:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788813269.955336:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788813269.955352:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788813269.955368:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788813269.955382:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788813269.955396:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788813269.955410:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788813269.955438:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788813269.955453:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788813269.955466:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788813269.955479:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788813269.955492:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788813269.955505:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788813269.955519:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788813269.955533:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788813269.955548:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788813269.955571:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788813269.955585:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788813269.955598:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788813269.955612:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788813269.955625:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788813269.955638:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788813269.955650:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788813269.955678:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788813269.955695:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788813269.955709:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788813269.955723:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788813269.955737:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788813269.956159:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788813269.956180:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788813269.956193:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788813269.956204:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788813269.956216:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788813269.956227:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788813269.956238:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788813269.956250:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788813269.956261:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788813269.956273:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788813269.956284:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788813269.956308:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788813269.956321:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788813269.956334:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788813269.956346:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788813269.956358:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788813269.956371:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788813269.956382:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788813269.956395:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788813269.956408:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788813269.956447:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313353216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813269.956502:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813269.956524:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788813269.956695:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313353216 00000100:00100000:1.0:1788813269.956702:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313353216 00000100:00100000:1.0:1788813269.956754:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788813269.956764:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+21:18664:x1875706313353216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813269.956864:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+21:18664:x1875706313353216:12345-0@lo:502:mount.lustre.0 Request processed in 102us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813269.956871:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788813269.959098:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313353216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788813269.959307:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788813269.959336:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788813269.959374:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313353344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813269.959438:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813269.959471:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788813269.959532:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313353344 00000100:00100000:1.0:1788813269.959545:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313353344 00000100:00100000:1.0:1788813269.959596:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788813269.959606:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+21:18664:x1875706313353344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813269.959722:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+21:18664:x1875706313353344:12345-0@lo:502:mount.lustre.0 Request processed in 118us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813269.959729:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788813269.959894:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313353344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788813269.959965:0:18664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788813269.959974:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788813269.961087:0:18691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788813269.961103:0:18691:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff948a506e19c0) 00000020:00000080:1.0:1788813269.961127:0:18691:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788813269.961350:0:18691:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948943443000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788813269.961354:0:18691:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948943443000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788813269.961357:0:18691:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948943443000 3 00010000:00080000:1.0:1788813269.961392:0:18691:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a4a56a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813269.966529:0:18691:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788813269.968640:0:18691:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788813269.968688:0:18691:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788813269.968704:0:18691:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf32533d6ff703d89 00000100:00080000:1.0:1788813269.968717:0:18691:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813269.968730:0:18691:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff948a4a56a000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813269.968766:0:18691:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a6a00 x1875706313353472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813269.968799:0:18691:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788813269.968869:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313353472:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788813269.968975:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788813269.969513:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813269.969518:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813269.969520:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813269.969523:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813269.969549:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813269.969558:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813269.969561:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813269.969564:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788813269.969604:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313353472 00000100:00100000:3.0:1788813269.969611:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313353472 00000100:00100000:3.0:1788813269.969645:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813269.969652:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1875706313353472:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788813269.969677:0:17161:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:3.0:1788813269.969873:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf32533d6ff703d90 00000004:00100000:3.0:1788813269.969890:0:17161:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788813269.969921:0:17161:0:(import.c:65:import_set_state_nolock()) ffff948a6ae40800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813269.970005:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875706313353472:12345-0@lo:38:llog_process_th.0 Request processed in 352us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813269.970013:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813269.970200:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313353856:0@lo:400:kworker.0 00000100:00100000:3.0:1788813269.970235:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813269.970261:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813269.970267:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313353984:0@lo:400:kworker.0 00000100:00100000:3.0:1788813269.970287:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813269.970373:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313353600:0@lo:400:kworker.0 00000100:00100000:1.0:1788813269.970398:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313353728:0@lo:400:kworker.0 00000100:00100000:2.0:1788813269.970407:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813269.970449:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313353856 00000100:00100000:2.0:1788813269.970455:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313353856 00000100:00100000:2.0:1788813269.970481:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313353600 00000100:00100000:2.0:1788813269.970483:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313353600 00000100:00100000:2.0:1788813269.970497:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788813269.970503:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313353856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813269.970514:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813269.970555:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313353856:12345-0@lo:400:kworker.0 Request processed in 51us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813269.970563:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788813269.970580:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813269.970587:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313353600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813269.970587:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313353984 00000100:00100000:1.0:1788813269.970593:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313353984 00000100:00100000:1.0:1788813269.970625:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313353728 00000100:00100000:1.0:1788813269.970629:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313353728 00000100:00100000:2.0:1788813269.970630:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313353600:12345-0@lo:400:kworker.0 Request processed in 43us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813269.970648:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788813269.970666:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813269.970675:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313353984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813269.970690:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313353600:0@lo:400:kworker.0 00000100:00100000:1.0:1788813269.970715:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875706313353984:12345-0@lo:400:kworker.0 Request processed in 40us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813269.970722:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813269.970739:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813269.970746:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313353728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813269.970755:0:17163:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788813269.970765:0:17163:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788813269.970795:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313353728:12345-0@lo:400:kworker.0 Request processed in 49us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813269.970802:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788813269.970809:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94894424dc00 x1875706313353984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813269.970821:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875706313353984:0@lo:400:kworker.0 00000100:00100000:3.0:1788813269.970833:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313353856:0@lo:400:kworker.0 00010000:00080000:3.0:1788813269.970871:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9489433a6a00 x1875706313353472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813269.970879:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788813269.970885:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788813269.970892:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788813269.970897:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788813269.970899:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a4a56a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788813269.970905:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1875706313353472:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788813269.970988:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94894424e300 x1875706313353728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813269.970998:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313353728:0@lo:400:kworker.0 00000020:01000004:1.0:1788813269.971087:0:18691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788813269.971101:0:18691:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff948a506e0000) 00000020:00000080:1.0:1788813269.971119:0:18691:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788813269.971475:0:18691:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948943443000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788813269.971480:0:18691:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948943443000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788813269.971482:0:18691:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948943443000 3 00010000:00080000:1.0:1788813269.971509:0:18691:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a4a569000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813269.974045:0:18691:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1788813269.976111:0:18691:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788813269.976172:0:18691:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788813269.976186:0:18691:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf32533d6ff703d9e 00000100:00080000:1.0:1788813269.977300:0:18691:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813269.977314:0:18691:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff948a4a569000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813269.977353:0:18691:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a6300 x1875706313354112/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813269.977379:0:18691:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788813269.977524:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813269.977530:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813269.977533:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813269.977536:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813269.977540:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813269.977543:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813269.977546:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813269.977549:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788813269.977576:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1875706313354112:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788813269.977646:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788813269.978585:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:2.0:1788813269.979244:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313354112 00000100:00100000:2.0:1788813269.979254:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313354112 00000100:00100000:2.0:1788813269.980670:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788813269.980680:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313354112:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788813269.980714:0:17164:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:2.0:1788813269.980778:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf32533d6ff703da5 00000004:00100000:2.0:1788813269.980796:0:17164:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788813269.980830:0:17164:0:(import.c:65:import_set_state_nolock()) ffff948a7cce6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813269.980925:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875706313354112:12345-0@lo:38:llog_process_th.0 Request processed in 245us (3278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813269.980960:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788813269.981056:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9489433a6300 x1875706313354112/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813269.981068:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788813269.981076:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788813269.981085:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788813269.981089:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788813269.981091:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a4a569000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788813269.981098:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1875706313354112:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1788813269.982882:0:18664:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788813269.982928:0:18664:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788813269.982980:0:18664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d7b expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813269.983008:0:18664:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948943656000/0xf32533d6ff703d74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703d7b expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788813269.983229:0:18664:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788813269.983232:0:18664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788813269.983233:0:18664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813269.983235:0:18664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813269.983236:0:18664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813269.983238:0:18664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813269.983239:0:18664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788813269.983241:0:18664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813269.983243:0:18664:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788813269.983246:0:18664:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788813269.983249:0:18664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788813269.983250:0:18664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788813269.983251:0:18664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813269.983253:0:18664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813269.983254:0:18664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813269.983255:0:18664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813269.983255:0:18664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788813269.983256:0:18664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813269.983257:0:18664:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788813269.983284:0:18664:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788813269.983306:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46547100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313354240:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788813269.983368:0:18664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813269.983413:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50cdbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813269.983469:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313354240 00000100:00100000:1.0:1788813269.983476:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313354240 00000100:00100000:1.0:1788813269.983526:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788813269.983536:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+21:18664:x1875706313354240:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788813269.983560:0:17154:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788813269.983572:0:17154:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788813269.988141:0:17154:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788813269.988163:0:17154:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788813269.988488:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+21:18664:x1875706313354240:12345-0@lo:253:mount.lustre.0 Request processed in 4949us (5114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813269.988501:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788813269.988594:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46547100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:18664:1875706313354240:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788813269.988607:0:18664:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788813269.988611:0:18664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788813269.988612:0:18664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788813269.988622:0:18664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813269.988623:0:18664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813269.988625:0:18664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813269.988626:0:18664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813269.988627:0:18664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813269.988629:0:18664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813269.988630:0:18664:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788813269.988645:0:18664:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788813269.989460:0:17178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788813269.989465:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788813269.989486:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703dac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.989502:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a43dad000/0xf32533d6ff703cf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703cef expref: 20 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.989510:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a43dad400/0xf32533d6ff703d04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703cfd expref: 20 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.989527:0:17178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703dac lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.989559:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a43dad400/0xf32533d6ff703d04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff703cfd expref: 20 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.989573:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a43dad400/0xf32533d6ff703d04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff703cfd expref: 20 pid: 17157 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813269.989587:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764caa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875706313354368:0@lo:104: 00000100:00100000:2.0:1788813269.989628:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813269.989669:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a43dad000/0xf32533d6ff703cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff703cef expref: 20 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.989677:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a43dad000/0xf32533d6ff703cf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff703cef expref: 20 pid: 17156 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813269.989685:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875706313354496:0@lo:104: 00000100:00100000:2.0:1788813269.989710:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813269.989725:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50c0fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813269.989747:0:17145:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788813269.989763:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313354368 00000100:00100000:2.0:1788813269.989768:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313354368 00000100:00100000:2.0:1788813269.989797:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313354496 00000100:00100000:2.0:1788813269.989800:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313354496 00000100:00100000:2.0:1788813269.989814:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813269.989822:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7e65740-fccd-471b-95df-6f83776cc95f+4:17178:x1875706313354368:12345-0@lo:104: 00010000:00010000:2.0:1788813269.989836:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703cfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703d04 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.989888:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788813269.989894:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7e65740-fccd-471b-95df-6f83776cc95f+4:17178:x1875706313354368:12345-0@lo:104: Request processed in 73us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813269.989901:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813269.989917:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813269.989923:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7cc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7e65740-fccd-471b-95df-6f83776cc95f+3:17178:x1875706313354496:12345-0@lo:104: 00010000:00010000:2.0:1788813269.989959:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a40030800/0xf32533d6ff703cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703cf6 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.989993:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788813269.989999:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7cc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7e65740-fccd-471b-95df-6f83776cc95f+3:17178:x1875706313354496:12345-0@lo:104: Request processed in 77us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813269.990004:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788813269.990052:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788813269.990057:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703cfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703d04 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990064:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac800 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:2.0:1788813269.990069:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703cfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff703d04 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990077:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703cfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff703d04 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813269.990084:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703cfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff703d04 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813269.990091:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788813269.990126:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703cfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703d04 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990132:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813269.990150:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703cfd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703d04 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990157:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703cfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703d04 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990170:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813269.990174:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a40030800/0xf32533d6ff703cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703cf6 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990179:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40030800 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:2.0:1788813269.990182:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a40030800/0xf32533d6ff703cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff703cf6 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990189:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a40030800/0xf32533d6ff703cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff703cf6 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813269.990195:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a40030800/0xf32533d6ff703cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff703cf6 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813269.990200:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788813269.990211:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a40030800/0xf32533d6ff703cef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703cf6 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990217:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813269.990223:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a40030800/0xf32533d6ff703cef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703cf6 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990239:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a40030800/0xf32533d6ff703cef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703cf6 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990252:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813269.990253:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813269.990255:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813269.990266:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313354624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813269.990289:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813269.990314:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813269.990319:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313354752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813269.990339:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813269.990372:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313354624 00000100:00100000:2.0:1788813269.990376:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313354624 00010000:00010000:2.0:1788813269.990392:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a43dad400/0xf32533d6ff703d04 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703cfd expref: 21 pid: 17157 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813269.990410:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313354752 00000100:00100000:2.0:1788813269.990413:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313354752 00010000:00010000:2.0:1788813269.990422:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a43dad000/0xf32533d6ff703cf6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703cef expref: 22 pid: 17156 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813269.990435:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813269.990440:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7e65740-fccd-471b-95df-6f83776cc95f+22:3625:x1875706313354624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813269.990449:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813269.990453:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a43dad400/0xf32533d6ff703d04 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703cfd expref: 22 pid: 17157 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990462:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a43dad400/0xf32533d6ff703d04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff703cfd expref: 22 pid: 17157 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990481:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813269.990508:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7e65740-fccd-471b-95df-6f83776cc95f+22:3625:x1875706313354624:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813269.990514:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813269.990527:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813269.990533:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ca6f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7e65740-fccd-471b-95df-6f83776cc95f+21:3625:x1875706313354752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813269.990540:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813269.990543:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a43dad000/0xf32533d6ff703cf6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703cef expref: 21 pid: 17156 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990552:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a43dad000/0xf32533d6ff703cf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff703cef expref: 21 pid: 17156 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990563:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703dac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990571:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703dac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788813269.990584:0:17148:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002333126s 00010000:00010000:2.0:1788813269.990588:0:17148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703dac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990595:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703dac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990602:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703dac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990618:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703dac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990623:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08c00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813269.990628:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703dac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990635:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703dac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990644:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703dac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990653:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813269.990675:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ca6f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7e65740-fccd-471b-95df-6f83776cc95f+21:3625:x1875706313354752:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813269.990681:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813269.990728:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313354752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813269.990736:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313354624:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813269.990758:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a43dad400/0xf32533d6ff703d04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff703cfd expref: 20 pid: 17157 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813269.990769:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764caa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875706313354368:0@lo:104: 00010000:00010000:2.0:1788813269.990778:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a43dad000/0xf32533d6ff703cf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff703cef expref: 19 pid: 17156 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813269.990785:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875706313354496:0@lo:104: 00010000:00010000:2.0:1788813269.990805:0:17178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703dac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990813:0:17178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703dac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990820:0:17178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703dac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.990826:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff703dac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813269.990962:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788813269.994778:0:18664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788813269.997146:0:18664:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788813269.997156:0:18664:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788813269.997190:0:18664:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788813269.997232:0:18664:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788813269.997249:0:18664:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788813269.997269:0:18664:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788813269.998008:0:18664:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813269.998180:0:18664:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788813270.436084:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788813270.798814:0:18744:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813270.799048:0:18744:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788813271.204063:0:17160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788813271.204072:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a7b569800 from 9 10000000:01000000:1.0:1788813271.204078:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788813271.204126:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703db3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813271.204139:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703db3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813271.204150:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703db3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813271.204177:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313354880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813271.204246:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813271.204296:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643c5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813271.204448:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313354880 00000100:00100000:2.0:1788813271.204457:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313354880 00000100:00100000:2.0:1788813271.204515:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788813271.204525:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+19:17160:x1875706313354880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813271.204549:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813271.204563:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc08000/0xf32533d6ff703dba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703db3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813271.204592:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc08000/0xf32533d6ff703dba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703db3 expref: 20 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813271.204603:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc08000/0xf32533d6ff703dba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703db3 expref: 20 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813271.204612:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08000, rc 0) 00000100:00100000:2.0:1788813271.204668:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+20:17160:x1875706313354880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813271.204690:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788813271.205449:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313354880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813271.205466:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703db3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703dba expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813271.205477:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703db3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703dba expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813271.205532:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313355008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788813271.205574:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813271.205610:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643c5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813271.205674:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313355008 00000100:00100000:0.0:1788813271.205679:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313355008 00000100:00100000:0.0:1788813271.205727:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788813271.205735:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+20:17160:x1875706313355008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788813271.205751:0:17154:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788813271.205766:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788813271.205770:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788813271.205853:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+20:17160:x1875706313355008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813271.205862:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788813271.206087:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313355008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788813271.206142:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788813271.206150:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703db3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703dba expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813271.206159:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703dba expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813271.206168:0:17160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788813271.206170:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9489437db000 from 9 10000000:01000000:1.0:1788813271.206173:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788813271.206192:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dada00/0xf32533d6ff703dc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813271.206200:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a43dada00/0xf32533d6ff703dc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813271.206208:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a43dada00/0xf32533d6ff703dc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813271.206222:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313355136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813271.206249:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813271.206285:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643c5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813271.206423:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313355136 00000100:00100000:3.0:1788813271.206429:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313355136 00000100:00100000:3.0:1788813271.206465:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788813271.206471:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+20:17160:x1875706313355136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813271.206480:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813271.206490:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948943657c00/0xf32533d6ff703dc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703dc1 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813271.206508:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948943657c00/0xf32533d6ff703dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703dc1 expref: 21 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813271.206517:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948943657c00/0xf32533d6ff703dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703dc1 expref: 21 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813271.206537:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657c00, rc 0) 00000100:00100000:3.0:1788813271.206569:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+21:17160:x1875706313355136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813271.206575:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788813271.206604:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313355136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813271.206615:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a43dada00/0xf32533d6ff703dc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703dc8 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813271.206622:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a43dada00/0xf32533d6ff703dc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703dc8 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813271.206662:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313355264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788813271.206691:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813271.206704:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a64231f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788813271.206714:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313355264 00000100:00100000:3.0:1788813271.206718:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313355264 00000100:00100000:3.0:1788813271.206736:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788813271.206741:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+21:17160:x1875706313355264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788813271.206752:0:17156:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788813271.206762:0:17156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788813271.206765:0:17156:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788813271.206830:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+21:17160:x1875706313355264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 87us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813271.206837:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788813271.206863:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313355264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788813271.206922:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788813271.206967:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dada00/0xf32533d6ff703dc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703dc8 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813271.206974:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a43dada00/0xf32533d6ff703dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703dc8 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813271.397078:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313355392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813271.397150:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813271.400228:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313355392 00000100:00100000:2.0:1788813271.400247:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313355392 00000100:00100000:2.0:1788813271.400304:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813271.400313:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313355392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813271.400349:0:17902:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788813271.401615:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313355392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1298us (4460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813271.401627:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788813271.402846:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313355520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813271.403056:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813271.404002:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313355392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813271.407120:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313355520 00000100:00100000:1.0:1788813271.407133:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313355520 00000100:00100000:1.0:1788813271.407177:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788813271.407186:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313355520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788813271.407228:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788813271.407315:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313355520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (4259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813271.407323:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788813271.407490:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313355520:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788813271.461401:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813272.484269:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813273.511037:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813274.532180:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788813274.982203:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813274.982210:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813274.982213:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813274.982215:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813274.982238:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813274.982241:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813274.982244:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813274.982247:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788813274.982285:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313356032:0@lo:400:kworker.0 00000100:00100000:3.0:1788813274.982359:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813274.982419:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788813274.982438:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313355904:0@lo:400:kworker.0 00000100:00100000:3.0:1788813274.982463:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813274.982479:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313356416:0@lo:400:kworker.0 00000100:00100000:3.0:1788813274.982498:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813274.982727:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313356032 00000100:00100000:1.0:1788813274.982736:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313356032 00000100:00100000:1.0:1788813274.982789:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813274.982798:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313356032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813274.982855:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313356032:12345-0@lo:400:kworker.0 Request processed in 58us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813274.982862:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813274.982981:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313356032:0@lo:400:kworker.0 00000100:00100000:2.0:1788813274.983375:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313355648:0@lo:400:kworker.0 00000100:00100000:2.0:1788813274.983418:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813274.983451:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313356160:0@lo:400:kworker.0 00000100:00100000:2.0:1788813274.983475:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813274.983506:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788813274.983512:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313355776:0@lo:400:kworker.0 00000100:00100000:2.0:1788813274.983535:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813274.983554:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313356288:0@lo:400:kworker.0 00000100:00100000:2.0:1788813274.983578:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813274.983629:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313355904 00000100:00100000:2.0:1788813274.983634:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313355904 00000100:00100000:2.0:1788813274.983673:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313356416 00000100:00100000:2.0:1788813274.983677:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313356416 00000100:00100000:2.0:1788813274.983700:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313356160 00000100:00100000:2.0:1788813274.983703:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313356160 00000100:00100000:2.0:1788813274.983714:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313356288 00000100:00100000:2.0:1788813274.983716:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313356288 00000100:00100000:2.0:1788813274.983731:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813274.983738:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313355904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813274.983778:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313355904:12345-0@lo:400:kworker.0 Request processed in 41us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813274.983784:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813274.983800:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813274.983808:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313356416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813274.983834:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313356416:12345-0@lo:400:kworker.0 Request processed in 28us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813274.983840:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813274.983854:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813274.983860:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313356160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813274.983899:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313356160:12345-0@lo:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813274.983905:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813274.983920:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788813274.983926:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313356288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813274.983977:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313356288:12345-0@lo:400:kworker.0 Request processed in 51us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813274.983983:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788813274.984007:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313355776 00000100:00100000:2.0:1788813274.984016:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313355776 00000100:00100000:2.0:1788813274.984041:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788813274.984047:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313355776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813274.984076:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313355776:12345-0@lo:400:kworker.0 Request processed in 29us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813274.984081:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788813274.984116:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313355776:0@lo:400:kworker.0 00010000:00080000:2.0:1788813274.984128:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a7ccfb100 x1875706313356288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813274.984136:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313356288:0@lo:400:kworker.0 00000100:00080000:1.0:1788813274.984260:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813274.984265:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788813274.984314:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a7ccf8000 x1875706313356160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813274.984324:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313356160:0@lo:400:kworker.0 00010000:00080000:2.0:1788813274.984359:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94894424e300 x1875706313355904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813274.984368:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313355904:0@lo:400:kworker.0 00010000:00080000:2.0:1788813274.984383:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a7ccf9880 x1875706313356416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813274.984392:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313356416:0@lo:400:kworker.0 00000100:00100000:3.0:1788813274.984572:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313355648 00000100:00100000:3.0:1788813274.984577:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313355648 00000100:00100000:3.0:1788813274.984619:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788813274.984627:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+21:3625:x1875706313355648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813274.984674:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+21:3625:x1875706313355648:12345-0@lo:400:kworker.0 Request processed in 49us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813274.984680:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788813274.985000:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313355648:0@lo:400:kworker.0 00010000:00010000:0.0:1788813275.558246:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813275.942708:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1788813276.464335:0:19034:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788813276.516167:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313356544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813276.516245:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813276.516346:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313356544 00000100:00100000:0.0:1788813276.516355:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313356544 00000100:00100000:0.0:1788813276.516407:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788813276.516417:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313356544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813276.516450:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788813276.516497:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313356544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813276.516504:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788813276.516583:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313356544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813276.518838:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313356672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813276.518920:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813276.519135:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313356672 00000100:00100000:1.0:1788813276.519144:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313356672 00000100:00100000:1.0:1788813276.519194:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788813276.519204:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313356672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788813276.519238:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788813276.519281:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313356672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813276.519287:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788813276.519364:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313356672:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788813276.589171:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813277.356462:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1788813277.502536:0:19086:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813277.502922:0:19086:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788813277.608243:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788813278.570232:0:19136:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788813278.570504:0:19136:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788813278.630962:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813279.661397:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788813280.106384:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813280.106402:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813280.106405:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813280.106409:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813280.106434:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813280.106438:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813280.106441:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813280.106444:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788813280.106548:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313356800:0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.106641:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813280.106696:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313357312:0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.106729:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813280.106760:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813280.106767:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313357184:0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.106795:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813280.106837:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313356928:0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.106873:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813280.106893:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313357440:0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.106924:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813280.106978:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788813280.106985:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313357056:0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.107013:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813280.107034:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313357568:0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.107073:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813280.107260:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313356800 00000100:00100000:1.0:1788813280.107271:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313356800 00000100:00100000:1.0:1788813280.107335:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788813280.107347:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+21:3626:x1875706313356800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.107406:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+21:3626:x1875706313356800:12345-0@lo:400:kworker.0 Request processed in 61us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813280.107414:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788813280.107468:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313357312 00000100:00100000:1.0:1788813280.107472:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313357312 00000100:00100000:1.0:1788813280.107497:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313357440 00000100:00100000:1.0:1788813280.107499:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313357440 00000100:00100000:1.0:1788813280.107525:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313357056 00000100:00100000:1.0:1788813280.107527:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313357056 00000100:00100000:1.0:1788813280.107539:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313357568 00000100:00100000:1.0:1788813280.107541:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313357568 00000100:00100000:1.0:1788813280.107557:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813280.107563:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313357312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.107596:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313357312:12345-0@lo:400:kworker.0 Request processed in 33us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813280.107602:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813280.107617:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813280.107623:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313357440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.107651:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875706313357440:12345-0@lo:400:kworker.0 Request processed in 29us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813280.107657:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813280.107669:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788813280.107674:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313357056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.107711:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875706313357056:12345-0@lo:400:kworker.0 Request processed in 37us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813280.107718:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788813280.107733:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788813280.107739:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313357568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.107765:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313357568:12345-0@lo:400:kworker.0 Request processed in 27us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813280.107772:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788813280.107802:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313357184 00000100:00100000:1.0:1788813280.107806:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313357184 00000100:00100000:1.0:1788813280.107832:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313356928 00000100:00100000:1.0:1788813280.107835:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313356928 00000100:00100000:1.0:1788813280.107859:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788813280.107865:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313357184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.107899:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313357184:12345-0@lo:400:kworker.0 Request processed in 34us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813280.107906:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788813280.107917:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788813280.107923:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313356928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.107987:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313356928:12345-0@lo:400:kworker.0 Request processed in 64us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813280.107992:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788813280.108047:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313357184:0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.108058:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313356800:0@lo:400:kworker.0 00010000:00080000:1.0:1788813280.108070:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489433a7800 x1875706313357312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788813280.109015:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813280.109023:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813280.111660:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313357312:0@lo:400:kworker.0 00010000:00080000:1.0:1788813280.111790:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489433a5180 x1875706313357056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813280.111810:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875706313357056:0@lo:400:kworker.0 00010000:00080000:1.0:1788813280.111827:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489433a5500 x1875706313357568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813280.111836:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313357568:0@lo:400:kworker.0 00000100:00100000:1.0:1788813280.111862:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313356928:0@lo:400:kworker.0 00010000:00080000:1.0:1788813280.111875:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489433a4000 x1875706313357440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813280.111883:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1875706313357440:0@lo:400:kworker.0 00000100:00100000:2.0:1788813280.229078:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813265/real 1788813265] req@ffff948944238000 x1875706313349632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813280 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813280.229114:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948944238000 x1875706313349632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813280 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813280.229123:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813265/real 1788813265] req@ffff948944239c00 x1875706313349760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813280 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813280.229134:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948944239c00 x1875706313349760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813280 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788813280.229154:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a611ac800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813280.229185:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788813280.229189:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313349632:0@lo:8:kworker.0 00000100:00080000:2.0:1788813280.229194:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b790000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813280.229199:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788813280.229202:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313349760:0@lo:8:kworker.0 00000100:00080000:3.0:1788813280.229272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813280.229277:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813280.229279:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813280.229282:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813280.229285:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813280.229288:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788813280.229291:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a611ac800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813280.229296:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 418 00000100:00080000:3.0:1788813280.229300:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788813280.229311:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff948a611ac800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813280.229359:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a7ccf8700 x1875706313357696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813280.229382:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813280.229385:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788813280.229386:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a7b790000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813280.229389:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 418 00000100:00080000:3.0:1788813280.229391:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788813280.229396:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff948a7b790000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788813280.229404:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a7ccfbb80 x1875706313357824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813280.229461:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313357696:0@lo:8:kworker.0 00000100:00100000:2.0:1788813280.229523:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813280.229567:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313357824:0@lo:8:kworker.0 00000100:00100000:2.0:1788813280.229588:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813280.229668:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313357696 00000100:00100000:3.0:1788813280.229676:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313357696 00000100:00100000:3.0:1788813280.229708:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313357824 00000100:00100000:3.0:1788813280.229711:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313357824 00000100:00100000:3.0:1788813280.229724:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813280.229731:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1875706313357696:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788813280.229762:0:18668:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:3.0:1788813280.229790:0:18668:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff703dcf 00002000:00100000:3.0:1788813280.229802:0:18668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff948a6ae42800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788813280.229806:0:18668:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788813280.229809:0:18668:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788813280.230022:0:18668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788813280.230045:0:18668:0:(import.c:65:import_set_state_nolock()) ffff948a6ae44800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813280.230090:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1875706313357696:12345-0@lo:8:kworker.0 Request processed in 357us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813280.230096:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813280.230118:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813280.230122:0:18670:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788813280.230123:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1875706313357824:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788813280.230129:0:18670:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00020000:3.0:1788813280.230135:0:18668:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788813280.230974:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a7ccf8700 x1875706313357696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813280.231000:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788813280.231008:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788813280.231016:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788813280.231021:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788813280.231023:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a611ac800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788813280.231038:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788813280.231044:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313357696:0@lo:8:kworker.0 00000004:00080000:0.0:1788813280.231065:0:17903:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788813280.231097:0:17905:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788813280.231115:0:17905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17905:1875706313358080:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788813280.231139:0:17903:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 433250206334ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788813280.231145:0:17903:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788813280.231149:0:17905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813280.231168:0:17905:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489434ac600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813280.231181:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313357952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813280.231209:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813280.231254:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313357952 00000100:00100000:2.0:1788813280.231259:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313358080 00000100:00100000:2.0:1788813280.231265:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313358080 00000100:00100000:0.0:1788813280.231265:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313357952 00000100:00100000:0.0:1788813280.231314:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813280.239131:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813280.239144:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:17905:x1875706313358080:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788813280.243015:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3625:x1875706313357952:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788813280.245228:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788813280.246813:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788813280.246910:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3625:x1875706313357952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 15585us (15696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813280.246923:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788813280.247028:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a764c9500 x1875706313357952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813280.247050:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313357952:0@lo:13:osp-pre-0-1.0 00002000:00080000:2.0:1788813280.249108:0:18670:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788813280.249117:0:18670:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788813280.249209:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17905:x1875706313358080:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10063us (18054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813280.249233:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788813280.249263:0:17905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a764c8380 x1875706313358080/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788813296 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813280.249281:0:17905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17905:1875706313358080:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788813280.249295:0:17905:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788813280.249342:0:17905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46544a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17905:1875706313358208:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788813280.249380:0:17905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813280.249412:0:17905:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6eb2df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813280.251154:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313358208 00000100:00100000:2.0:1788813280.251168:0:18671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313358208 00000100:00100000:2.0:1788813280.251222:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813280.251232:0:18671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17905:x1875706313358208:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788813280.251263:0:18671:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788813280.251332:0:18671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17905:x1875706313358208:12345-0@lo:5:osp-pre-0-1.0 Request processed in 102us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813280.251339:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813280.252671:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1875706313357824:12345-0@lo:8:kworker.0 Request processed in 22541us (23077us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813280.252683:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788813280.252916:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b790000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788813280.252924:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788813280.252929:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313357824:0@lo:8:kworker.0 00000004:00080000:1.0:1788813280.253914:0:17895:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:0.0:1788813280.254201:0:17905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a46544a80 x1875706313358208/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813296 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813280.254217:0:17905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46544a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17905:1875706313358208:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788813280.254230:0:17905:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788813280.254277:0:17905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46544a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17905:1875706313358336:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788813280.254332:0:17905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813280.254365:0:17905:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6eb2df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813280.254502:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313358336 00000100:00100000:1.0:1788813280.254510:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313358336 00000100:00100000:1.0:1788813280.254571:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813280.254589:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17905:x1875706313358336:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788813280.254632:0:18670:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1788813280.292075:0:18665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788813280.292093:0:18665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788813280.292621:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17905:x1875706313358336:12345-0@lo:5:osp-pre-0-1.0 Request processed in 38029us (38283us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788813280.292635:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788813280.292751:0:17905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a46544a80 x1875706313358336/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813296 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813280.292767:0:17905:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788813280.292775:0:17905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46544a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17905:1875706313358336:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788813280.292795:0:17905:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1788813280.292868:0:17905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17905:1875706313358464:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788813280.292907:0:17905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813280.292974:0:17905:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813280.293090:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313358464 00000100:00100000:2.0:1788813280.293097:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313358464 00000100:00100000:2.0:1788813280.293139:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813280.293148:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17905:x1875706313358464:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788813280.293198:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17905:x1875706313358464:12345-0@lo:900:osp-pre-0-1.0 Request processed in 52us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813280.293205:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788813280.293268:0:17905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94894424e300 x1875706313358464/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788813296 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813280.293278:0:17905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17905:1875706313358464:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1788813280.676272:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813281.636332:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894424e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313358592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813281.636431:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813281.636643:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313358592 00000100:00100000:1.0:1788813281.636655:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313358592 00000100:00100000:1.0:1788813281.636719:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788813281.636729:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313358592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788813281.636773:0:17902:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788813281.636847:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313358592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813281.636854:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788813281.637080:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313358592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813281.659253:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788813281.659288:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313358720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813281.659392:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813281.659499:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313358720 00000100:00100000:3.0:1788813281.659511:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313358720 00000100:00100000:3.0:1788813281.659660:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788813281.659672:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313358720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788813281.659720:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788813281.659786:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313358720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813281.659794:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788813281.663366:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313358720:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788813281.702533:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813282.724313:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813283.749523:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813284.774516:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813285.164736:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1788813285.732485:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813285.732506:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813285.732509:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813285.732512:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813285.732603:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813285.732606:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788813285.732611:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a7b790000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813285.732619:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 433 00000100:00080000:0.0:1788813285.732625:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788813285.732636:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff948a7b790000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788813285.732659:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a46544a80 x1875706313359488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813285.732710:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313359104:0@lo:400:kworker.0 00000100:00100000:0.0:1788813285.732797:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813285.732850:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313359744:0@lo:400:kworker.0 00000100:00100000:0.0:1788813285.732873:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813285.732899:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788813285.732904:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313358976:0@lo:400:kworker.0 00000100:00100000:0.0:1788813285.732926:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813285.732987:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313359616:0@lo:400:kworker.0 00000100:00100000:0.0:1788813285.733010:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813285.733059:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313359488:0@lo:8:kworker.0 00000100:00100000:0.0:1788813285.733087:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813285.733131:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313359104 00000100:00100000:0.0:1788813285.733139:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313359104 00000100:00100000:0.0:1788813285.733189:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313359744 00000100:00100000:0.0:1788813285.733193:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313359744 00000100:00100000:0.0:1788813285.733222:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313359616 00000100:00100000:0.0:1788813285.733225:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313359616 00000100:00100000:0.0:1788813285.733239:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813285.733247:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313359104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813285.733299:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313359104:12345-0@lo:400:kworker.0 Request processed in 52us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813285.733306:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813285.733325:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813285.733331:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313359744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813285.733357:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313359744:12345-0@lo:400:kworker.0 Request processed in 26us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813285.733363:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813285.733378:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788813285.733384:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313359616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813285.733408:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313359616:12345-0@lo:400:kworker.0 Request processed in 25us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813285.733414:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788813285.733433:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313358976 00000100:00100000:0.0:1788813285.733437:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313358976 00000100:00100000:0.0:1788813285.733464:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788813285.733470:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313358976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813285.733505:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313358976:12345-0@lo:400:kworker.0 Request processed in 31us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813285.733511:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788813285.733541:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813285.733583:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313358976:0@lo:400:kworker.0 00010000:00080000:0.0:1788813285.733595:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a46546300 x1875706313359616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813285.733604:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313359616:0@lo:400:kworker.0 00010000:00080000:0.0:1788813285.733612:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a46546680 x1875706313359104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813285.733620:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313359104:0@lo:400:kworker.0 00010000:00080000:0.0:1788813285.733629:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a46544e00 x1875706313359744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813285.733636:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313359744:0@lo:400:kworker.0 00000100:00100000:1.0:1788813285.734009:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313359232:0@lo:400:kworker.0 00000100:00100000:1.0:1788813285.734049:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813285.734085:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313359872:0@lo:400:kworker.0 00000100:00100000:1.0:1788813285.734105:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813285.734125:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788813285.734131:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313358848:0@lo:400:kworker.0 00000100:00100000:1.0:1788813285.734157:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813285.734181:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313359360:0@lo:400:kworker.0 00000100:00100000:1.0:1788813285.734203:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813285.734236:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313359872 00000100:00100000:1.0:1788813285.734241:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313359872 00000100:00100000:1.0:1788813285.734274:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788813285.734280:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313359872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813285.734316:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313359872:12345-0@lo:400:kworker.0 Request processed in 36us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813285.734321:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788813285.734345:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313359488 00000100:00100000:1.0:1788813285.734348:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313359488 00000100:00100000:1.0:1788813285.734364:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313359360 00000100:00100000:1.0:1788813285.734367:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313359360 00000100:00100000:1.0:1788813285.734389:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813285.734395:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313359360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813285.734425:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313359360:12345-0@lo:400:kworker.0 Request processed in 30us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813285.734430:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813285.734442:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813285.734445:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3624:x1875706313359488:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788813285.734469:0:19191:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788813285.734501:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3624:x1875706313359488:12345-0@lo:8:kworker.0 Request processed in 54us (1414us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788813285.734507:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813285.734527:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313358848 00000100:00100000:1.0:1788813285.734530:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313358848 00000100:00100000:1.0:1788813285.734554:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788813285.734560:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+21:3627:x1875706313358848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813285.734588:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+21:3627:x1875706313358848:12345-0@lo:400:kworker.0 Request processed in 28us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813285.734593:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1788813285.734633:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813285.734637:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788813285.734659:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b790000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788813285.734663:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788813285.734667:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313359488:0@lo:8:kworker.0 00000100:00100000:1.0:1788813285.734690:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313358848:0@lo:400:kworker.0 00010000:00080000:1.0:1788813285.734700:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a46545500 x1875706313359360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813285.734709:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313359360:0@lo:400:kworker.0 00010000:00080000:1.0:1788813285.734718:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948a46547100 x1875706313359872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813285.734726:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313359872:0@lo:400:kworker.0 00000100:00100000:3.0:1788813285.735158:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813285.735170:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313360000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813285.735208:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813285.735277:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313360000 00000100:00100000:1.0:1788813285.735289:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313360000 00000100:00100000:1.0:1788813285.735324:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813285.735331:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313360000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788813285.735352:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788813285.735398:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313360000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813285.735404:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788813285.735430:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489433a4700 x1875706313360000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813285.735442:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313360000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813285.735542:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313359232 00000100:00100000:0.0:1788813285.735546:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313359232 00000100:00100000:0.0:1788813285.735586:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788813285.735594:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313359232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813285.735646:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313359232:12345-0@lo:400:kworker.0 Request processed in 53us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813285.735651:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788813285.735714:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313359232:0@lo:400:kworker.0 00010000:00010000:2.0:1788813285.796231:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788813286.216873:0:19482:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788813286.216878:0:19482:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788813286.216879:0:19482:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788813286.217037:0:19482:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff948a7ccad800 00000020:01000004:1.0:1788813286.217055:0:19482:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788813286.217071:0:19482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788813286.217087:0:19482:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff948a506e3380) 00000020:00000080:1.0:1788813286.217104:0:19482:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788813286.298085:0:19482:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788813286.301578:0:19482:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788813286.303950:0:19482:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788813286.305065:0:19482:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788813286.305439:0:19482:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788813286.305727:0:19482:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788813286.306006:0:19482:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1788813286.307079:0:19482:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788813286.307362:0:19482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788813286.307848:0:19482:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788813286.307862:0:19482:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf32533d6ff703ddd 00000020:01000004:2.0:1788813286.307869:0:19482:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788813286.307890:0:19482:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.113@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788813286.307894:0:19482:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788813286.307899:0:19482:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788813286.308076:0:19482:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788813286.310473:0:19482:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788813286.348139:0:19482:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788813286.348175:0:19482:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.113@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788813286.348179:0:19482:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788813286.348181:0:19482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788813286.348182:0:19482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813286.348187:0:19482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813286.348257:0:19482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813286.348258:0:19482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813286.348260:0:19482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813286.348262:0:19482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813286.348263:0:19482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813286.348267:0:19482:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788813286.348270:0:19482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788813286.348271:0:19482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788813286.348272:0:19482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813286.348273:0:19482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813286.348274:0:19482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813286.348275:0:19482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813286.348276:0:19482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813286.348277:0:19482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813286.348278:0:19482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813286.348304:0:19482:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788813286.348325:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313360128:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788813286.348405:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813286.348501:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643c5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813286.348729:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313360128 00000100:00100000:0.0:1788813286.348738:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313360128 00000100:00100000:0.0:1788813286.349367:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788813286.349380:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+21:19482:x1875706313360128:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788813286.349435:0:17156:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788813286.349439:0:17156:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788813286.349449:0:17156:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788813286.350615:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+21:19482:x1875706313360128:12345-0@lo:253:mount.lustre.0 Request processed in 1232us (2203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813286.350629:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788813286.350731:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313360128:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788813286.350764:0:19482:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788813286.350767:0:19482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788813286.350769:0:19482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788813286.350770:0:19482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813286.350771:0:19482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813286.350772:0:19482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813286.350774:0:19482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813286.350775:0:19482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813286.350777:0:19482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813286.350779:0:19482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788813286.350818:0:19482:0:(tgt_mount.c:101:server_register_mount()) register mount ffff948a7ccad800 from lustre-OST0001 10000000:01000000:3.0:1788813286.350848:0:19482:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788813286.350851:0:19482:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788813286.350861:0:19482:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff948942dccd40 local copy 00010000:00010000:3.0:1788813286.350872:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813286.351017:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313360256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813286.351051:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813286.351736:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643c59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813286.352035:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313360256 00000100:00100000:1.0:1788813286.352044:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313360256 00000100:00100000:1.0:1788813286.352088:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788813286.352097:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+21:19482:x1875706313360256:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813286.352186:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+21:19482:x1875706313360256:12345-0@lo:501:mount.lustre.0 Request processed in 90us (1134us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813286.352206:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788813286.352249:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313360256:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788813286.352266:0:19482:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788813286.352296:0:19482:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788813286.352303:0:19482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.352313:0:19482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a43dac000/0xf32533d6ff703af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703afe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813286.352341:0:19482:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff948a7ccad800 10000000:01000000:1.0:1788813286.352346:0:19482:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788813286.352351:0:19482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788813286.352353:0:19482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788813286.352357:0:19482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788813286.352360:0:19482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788813286.352387:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.352394:0:19482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.352403:0:19482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813286.352415:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313360384:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788813286.352443:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.352464:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313360384 00000100:00100000:1.0:1788813286.352468:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313360384 00000100:00100000:1.0:1788813286.352617:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788813286.352624:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+21:19482:x1875706313360384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813286.352633:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813286.352649:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a43dac600/0xf32533d6ff703deb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703de4 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.352667:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a43dac600/0xf32533d6ff703deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703de4 expref: 22 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.352677:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a43dac600/0xf32533d6ff703deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703de4 expref: 22 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.352685:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a43dac600, rc 0) 00000100:00100000:1.0:1788813286.352708:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+22:19482:x1875706313360384:12345-0@lo:101:mount.lustre.0 Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.352714:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788813286.352744:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a413590c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813286.353120:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313360384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813286.353135:0:19482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703deb expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.353145:0:19482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703deb expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788813286.355161:0:19482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788813286.356185:0:19482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813286.360625:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788813286.360686:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788813286.360703:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788813286.360716:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788813286.360730:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788813286.360744:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788813286.361367:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788813286.361383:0:19482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788813286.361575:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313360512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813286.361654:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.361776:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a413590c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813286.362094:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313360512 00000100:00100000:2.0:1788813286.362104:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313360512 00000100:00100000:2.0:1788813286.362211:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788813286.362225:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+22:19482:x1875706313360512:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813286.362516:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+22:19482:x1875706313360512:12345-0@lo:501:mount.lustre.0 Request processed in 293us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813286.362525:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788813286.362795:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313360512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813286.362849:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313360640:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813286.362904:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813286.363319:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643c5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813286.363363:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313360640 00000100:00100000:1.0:1788813286.363369:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313360640 00000100:00100000:1.0:1788813286.363403:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788813286.363411:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+22:19482:x1875706313360640:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813286.364463:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+22:19482:x1875706313360640:12345-0@lo:503:mount.lustre.0 Request processed in 1046us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.364474:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788813286.364657:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313360640:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788813286.365441:0:19482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788813286.365683:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313360768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813286.365743:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813286.366026:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643c5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813286.366151:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313360768 00000100:00100000:0.0:1788813286.366159:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313360768 00000100:00100000:2.0:1788813286.366359:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788813286.366372:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+22:19482:x1875706313360768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813286.367041:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+22:19482:x1875706313360768:12345-0@lo:502:mount.lustre.0 Request processed in 670us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813286.367050:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788813286.367287:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313360768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788813286.367601:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788813286.367630:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788813286.367646:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788813286.367661:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788813286.367675:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788813286.367689:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788813286.367703:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788813286.367714:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788813286.367723:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788813286.367885:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313360896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813286.367953:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813286.368004:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643c5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813286.368075:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313360896 00000100:00100000:2.0:1788813286.368088:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313360896 00000100:00100000:2.0:1788813286.368138:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788813286.368147:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+22:19482:x1875706313360896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813286.368378:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+22:19482:x1875706313360896:12345-0@lo:502:mount.lustre.0 Request processed in 232us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813286.368385:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788813286.368671:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313360896:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813286.368732:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788813286.368742:0:19482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788813286.371286:0:19486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788813286.371299:0:19486:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788813286.371306:0:19486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813286.371309:0:19486:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788813286.371315:0:19486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788813286.371331:0:19486:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff948a6adb3380) 00000020:00000080:3.0:1788813286.371357:0:19486:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788813286.371362:0:19486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788813286.371434:0:19486:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a7ccad800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788813286.371443:0:19486:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788813286.371452:0:19486:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf32533d6ff703df9 00010000:00010000:3.0:1788813286.380278:0:19486:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788813286.380909:0:19486:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788813286.385405:0:19486:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788813286.395026:0:19486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788813286.395041:0:19486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813286.395048:0:19486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813286.395051:0:19486:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788813286.395058:0:19486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813286.395062:0:19486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813286.395063:0:19486:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788813286.395067:0:19486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788813286.395069:0:19486:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788813286.395071:0:19486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813286.395073:0:19486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813286.395074:0:19486:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788813286.395076:0:19486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813286.395078:0:19486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813286.395080:0:19486:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788813286.395083:0:19486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788813286.395112:0:19486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813286.395115:0:19486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813286.395116:0:19486:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788813286.395119:0:19486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788813286.401134:0:19482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788813286.401179:0:19482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788813286.401611:0:19482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703deb expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.401625:0:19482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a43dade00/0xf32533d6ff703de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703deb expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813286.401634:0:19482:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a7ccad800 from 1 10000000:01000000:1.0:1788813286.401637:0:19482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813286.401679:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dace00/0xf32533d6ff703e00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.401688:0:19482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a43dace00/0xf32533d6ff703e00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.401699:0:19482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a43dace00/0xf32533d6ff703e00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813286.401739:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788813286.402177:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.402303:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50590480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813286.408834:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313361024 00000100:00100000:0.0:1788813286.408855:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313361024 00000100:00100000:0.0:1788813286.408963:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788813286.408991:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+22:19482:x1875706313361024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813286.409011:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813286.409031:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cda800/0xf32533d6ff703e07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703e00 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.409060:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cda800/0xf32533d6ff703e07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703e00 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.409072:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cda800/0xf32533d6ff703e07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703e00 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.409081:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cda800, rc 0) 00000100:00100000:0.0:1788813286.409170:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+23:19482:x1875706313361024:12345-0@lo:101:mount.lustre.0 Request processed in 182us (6994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813286.409178:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788813286.409451:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361024:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813286.409472:0:19482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a43dace00/0xf32533d6ff703e00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703e07 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.409494:0:19482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a43dace00/0xf32533d6ff703e00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703e07 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788813286.411616:0:19482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788813286.412146:0:19482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813286.412323:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788813286.412347:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788813286.412364:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788813286.412370:0:19482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788813286.412445:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813286.412634:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.412717:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50590480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813286.423367:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313361152 00000100:00100000:3.0:1788813286.423387:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313361152 00000100:00100000:0.0:1788813286.423523:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788813286.423534:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:19482:x1875706313361152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813286.423716:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:19482:x1875706313361152:12345-0@lo:501:mount.lustre.0 Request processed in 183us (11081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813286.423724:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788813286.424025:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813286.424079:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813286.424142:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813286.424182:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a459399c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813286.424512:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313361280 00000100:00100000:0.0:1788813286.424519:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313361280 00000100:00100000:0.0:1788813286.424546:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788813286.424552:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:19482:x1875706313361280:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813286.424648:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:19482:x1875706313361280:12345-0@lo:503:mount.lustre.0 Request processed in 95us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813286.424656:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788813286.424722:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361280:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788813286.425577:0:19482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813286.425672:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813286.425730:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813286.426293:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313361408 00000100:00100000:0.0:1788813286.426299:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313361408 00000100:00100000:0.0:1788813286.426331:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788813286.426339:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:19482:x1875706313361408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813286.426434:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:19482:x1875706313361408:12345-0@lo:502:mount.lustre.0 Request processed in 95us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813286.426442:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788813286.426494:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b4c9840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813286.426513:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813286.426722:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788813286.427571:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788813286.427600:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788813286.427614:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788813286.427626:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788813286.427638:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788813286.427652:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788813286.427664:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788813286.427676:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788813286.427689:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788813286.427702:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788813286.427741:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361536:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813286.428399:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813286.428472:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b4c9840 going to sleep for 11 seconds 00000100:00100000:3.0:1788813286.431355:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313361536 00000100:00100000:3.0:1788813286.431372:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313361536 00000100:00100000:3.0:1788813286.431433:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788813286.431444:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:19482:x1875706313361536:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813286.431635:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:19482:x1875706313361536:12345-0@lo:502:mount.lustre.0 Request processed in 193us (3235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813286.431643:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788813286.433674:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361536:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813286.434157:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788813286.434173:0:19482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788813286.463530:0:19490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813286.463545:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813286.463547:0:19490:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788813286.463557:0:19490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a7ccad800 00000020:00000080:2.0:1788813286.463560:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813286.463568:0:19490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813286.463571:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813286.463572:0:19490:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788813286.463575:0:19490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813286.463577:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813286.463578:0:19490:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788813286.463581:0:19490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948a7ccad800 00000020:00000080:2.0:1788813286.463583:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813286.463648:0:19490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813286.463651:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813286.463653:0:19490:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788813286.463655:0:19490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813286.463658:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813286.463659:0:19490:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788813286.463669:0:19490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a7ccad800 00000020:00000080:2.0:1788813286.463671:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813286.463690:0:19490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813286.463692:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813286.463694:0:19490:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788813286.463696:0:19490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813286.463698:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813286.463699:0:19490:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788813286.463702:0:19490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948a7ccad800 00000020:00000080:2.0:1788813286.463704:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813286.463725:0:19490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813286.463729:0:19490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813286.463731:0:19490:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788813286.463733:0:19490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788813286.469318:0:19482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788813286.469368:0:19482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813286.469428:0:19482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dace00/0xf32533d6ff703e00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703e07 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.469441:0:19482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a43dace00/0xf32533d6ff703e00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703e07 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813286.469515:0:19482:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788813286.469519:0:19482:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff948a7ccad800 10000000:01000000:1.0:1788813286.469522:0:19482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff948a7ccad800 10000000:01000000:1.0:1788813286.469525:0:19482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788813286.469532:0:19482:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948a7ccad800 from 1 10000000:01000000:1.0:1788813286.469535:0:19482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788813286.469570:0:19482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.469587:0:19482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.469599:0:19482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813286.469622:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788813286.469690:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.469737:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a643c5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813286.478354:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313361664 00000100:00100000:0.0:1788813286.478372:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313361664 00000100:00100000:0.0:1788813286.478448:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788813286.478459:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:19482:x1875706313361664:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813286.478477:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813286.478497:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cda600/0xf32533d6ff703e15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703e0e expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.478543:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cda600/0xf32533d6ff703e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703e0e expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.478556:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cda600/0xf32533d6ff703e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703e0e expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.478566:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cda600, rc 0) 00000100:00100000:0.0:1788813286.478655:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+24:19482:x1875706313361664:12345-0@lo:101:mount.lustre.0 Request processed in 198us (8964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813286.478662:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788813286.479459:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813286.479483:0:19482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703e15 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.479493:0:19482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703e15 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813286.500802:0:19482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1788813286.501403:0:19482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813286.501656:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788813286.501680:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788813286.501693:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788813286.501704:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788813286.501715:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788813286.501726:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788813286.501738:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788813286.501775:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788813286.501800:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788813286.502105:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788813286.502122:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788813286.502135:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788813286.502148:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788813286.502160:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788813286.502173:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788813286.502183:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788813286.502195:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788813286.502209:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788813286.502240:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788813286.502256:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788813286.502269:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788813286.502282:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788813286.502296:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788813286.502310:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788813286.502323:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788813286.502336:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788813286.502348:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788813286.502359:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788813286.502370:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788813286.502381:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788813286.502395:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788813286.502408:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788813286.502421:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788813286.502435:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788813286.502463:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788813286.502478:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788813286.502505:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788813286.502518:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788813286.502528:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1788813286.502539:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1788813286.502561:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1788813286.502572:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1788813286.502584:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1788813286.502596:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1788813286.502610:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1788813286.502623:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1788813286.502644:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1788813286.502649:0:19482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1788813286.502740:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813286.507091:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813286.507141:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b4c9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788813286.508616:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313361792 00000100:00100000:0.0:1788813286.508627:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313361792 00000100:00100000:0.0:1788813286.508692:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788813286.508702:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+24:19482:x1875706313361792:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813286.509019:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+24:19482:x1875706313361792:12345-0@lo:501:mount.lustre.0 Request processed in 318us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813286.509026:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788813286.509090:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813286.509141:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813286.509194:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813286.509213:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7b4c9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788813286.509231:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313361920 00000100:00100000:0.0:1788813286.509235:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313361920 00000100:00100000:0.0:1788813286.509260:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788813286.509266:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+24:19482:x1875706313361920:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813286.509346:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+24:19482:x1875706313361920:12345-0@lo:503:mount.lustre.0 Request processed in 79us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813286.509360:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788813286.509400:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313361920:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788813286.511681:0:19482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813286.513647:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313362048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813286.513740:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813286.516887:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb540 going to sleep for 11 seconds 00000100:00100000:3.0:1788813286.520361:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313362048 00000100:00100000:3.0:1788813286.520375:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313362048 00000100:00100000:0.0:1788813286.527075:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788813286.527088:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+24:19482:x1875706313362048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813286.527255:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+24:19482:x1875706313362048:12345-0@lo:502:mount.lustre.0 Request processed in 169us (13515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813286.527262:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788813286.527349:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313362048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813286.527608:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788813286.527638:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788813286.527651:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788813286.527663:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788813286.527675:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788813286.527687:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788813286.527700:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788813286.527712:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788813286.527724:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788813286.527737:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788813286.527751:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788813286.527765:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788813286.527779:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788813286.527806:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788813286.527833:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788813286.527858:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788813286.527886:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788813286.527901:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788813286.527913:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788813286.527926:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788813286.527967:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788813286.527982:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788813286.527996:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788813286.528011:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788813286.528025:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788813286.528039:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788813286.528053:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788813286.528066:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788813286.528080:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788813286.528094:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788813286.528107:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788813286.528121:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788813286.528145:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788813286.528160:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788813286.528171:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788813286.528184:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788813286.528197:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788813286.528211:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788813286.528224:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788813286.528238:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788813286.528250:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788813286.528264:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788813286.528278:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788813286.528293:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788813286.528306:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788813286.528319:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788813286.528331:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788813286.528342:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788813286.528411:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313362176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813286.528468:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813286.528506:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788813286.528535:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313362176 00000100:00100000:0.0:1788813286.528543:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313362176 00000100:00100000:0.0:1788813286.528583:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788813286.528591:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+24:19482:x1875706313362176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813286.528691:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+24:19482:x1875706313362176:12345-0@lo:502:mount.lustre.0 Request processed in 99us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813286.528698:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788813286.528750:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313362176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813286.528904:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788813286.528923:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788813286.528968:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313362304:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813286.528999:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813286.529022:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313362304 00000100:00100000:0.0:1788813286.529026:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313362304 00000100:00100000:0.0:1788813286.529049:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788813286.529056:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+24:19482:x1875706313362304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813286.529111:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+24:19482:x1875706313362304:12345-0@lo:502:mount.lustre.0 Request processed in 56us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813286.529118:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788813286.529144:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788813286.529155:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313362304:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813286.529184:0:19482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788813286.529192:0:19482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788813286.536160:0:19495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788813286.536178:0:19495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff948a6edb8000) 00000020:00000080:1.0:1788813286.536204:0:19495:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788813286.536306:0:19495:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a7ccad800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788813286.536311:0:19495:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a7ccad800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788813286.536314:0:19495:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7ccad800 3 00010000:00080000:1.0:1788813286.536343:0:19495:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948a7cceb000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813286.542345:0:19495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788813286.542611:0:19495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788813286.542665:0:19495:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788813286.542683:0:19495:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf32533d6ff703e23 00000100:00080000:1.0:1788813286.542693:0:19495:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813286.542714:0:19495:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff948a7cceb000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813286.542748:0:19495:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a7800 x1875706313362432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813286.545900:0:19495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788813286.545985:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813286.545990:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813286.545992:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813286.545995:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813286.546028:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813286.546031:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788813286.546035:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a7b790000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813286.546041:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 438 00000100:00080000:1.0:1788813286.546045:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788813286.546058:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff948a7b790000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813286.546080:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489433a4700 x1875706313363072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788813286.546126:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313362560:0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.546198:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.546237:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313363200:0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.546263:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.546287:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788813286.546293:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313362688:0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.546313:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.546345:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313363328:0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.546385:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.546417:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313362816:0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.546441:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.546460:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313363456:0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.546479:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.546511:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813286.546518:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313362944:0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.546540:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.546570:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313362560 00000100:00100000:1.0:1788813286.546578:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313362560 00000100:00100000:1.0:1788813286.546619:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313362816 00000100:00100000:1.0:1788813286.546622:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313362816 00000100:00100000:1.0:1788813286.546637:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788813286.546645:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313362560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.546702:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313362560:12345-0@lo:400:kworker.0 Request processed in 57us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.546710:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788813286.546726:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788813286.546732:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313362816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.546760:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313362816:12345-0@lo:400:kworker.0 Request processed in 29us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.546766:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788813286.546808:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313363200 00000100:00100000:1.0:1788813286.546812:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313363200 00000100:00100000:1.0:1788813286.546833:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313362688 00000100:00100000:1.0:1788813286.546836:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313362688 00000100:00100000:1.0:1788813286.546859:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313363328 00000100:00100000:1.0:1788813286.546861:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313363328 00000100:00100000:1.0:1788813286.546873:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313363456 00000100:00100000:1.0:1788813286.546875:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313363456 00000100:00100000:1.0:1788813286.546888:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788813286.546894:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313363200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.546924:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313363200:12345-0@lo:400:kworker.0 Request processed in 31us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.546965:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788813286.546980:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788813286.546986:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313362688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.547012:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313362688:12345-0@lo:400:kworker.0 Request processed in 27us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.547018:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788813286.547032:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788813286.547037:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313363328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.547063:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313363328:12345-0@lo:400:kworker.0 Request processed in 26us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.547069:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788813286.547083:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788813286.547089:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313363456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.547128:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313363456:12345-0@lo:400:kworker.0 Request processed in 39us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.547134:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788813286.547169:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313362944 00000100:00100000:1.0:1788813286.547172:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313362944 00000100:00100000:1.0:1788813286.547198:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813286.547210:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313362944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.547241:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313362944:12345-0@lo:400:kworker.0 Request processed in 32us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.547247:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788813286.547283:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489433a5c00 x1875706313362688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813286.547297:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313362688:0@lo:400:kworker.0 00010000:00080000:1.0:1788813286.547308:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489435b0e00 x1875706313363328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813286.547316:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313363328:0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.547325:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313362560:0@lo:400:kworker.0 00010000:00080000:1.0:1788813286.547332:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489435b0700 x1875706313363200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813286.547339:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313363200:0@lo:400:kworker.0 00010000:00080000:1.0:1788813286.547377:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489433a5500 x1875706313362944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813286.547385:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313362944:0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.547394:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313362816:0@lo:400:kworker.0 00010000:00080000:1.0:1788813286.547402:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489435b3100 x1875706313363456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813286.547409:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313363456:0@lo:400:kworker.0 00000100:00100000:0.0:1788813286.547803:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313362432:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788813286.547854:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813286.547892:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313363072:0@lo:8:kworker.0 00000100:00100000:0.0:1788813286.547981:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.554611:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313362432 00000100:00100000:1.0:1788813286.554644:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313362432 00000100:00100000:1.0:1788813286.554707:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813286.554716:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3624:x1875706313362432:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788813286.554746:0:17163:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:1.0:1788813286.556033:0:17163:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf32533d6ff703e2a 00000004:00100000:1.0:1788813286.556058:0:17163:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788813286.556108:0:17163:0:(import.c:65:import_set_state_nolock()) ffff9489436ed800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813286.556244:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875706313362432:12345-0@lo:38:llog_process_th.0 Request processed in 1526us (8386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.556257:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813286.556324:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313363072 00000100:00100000:1.0:1788813286.556332:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313363072 00000100:00100000:1.0:1788813286.556361:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813286.556368:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3624:x1875706313363072:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788813286.556420:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3624:x1875706313363072:12345-0@lo:8:kworker.0 Request processed in 50us (8437us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788813286.556426:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788813286.558021:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489433a7800 x1875706313362432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813286.558038:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813286.558050:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788813286.558060:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788813286.558066:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788813286.558069:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7cceb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788813286.558078:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1875706313362432:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788813286.558103:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813286.558124:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b790000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788813286.558128:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788813286.558132:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313363072:0@lo:8:kworker.0 00000020:01000004:1.0:1788813286.558259:0:19495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788813286.558275:0:19495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff948a6edb99c0) 00000020:00000080:1.0:1788813286.558296:0:19495:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788813286.558376:0:19495:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948a7ccad800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788813286.558380:0:19495:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948a7ccad800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788813286.558383:0:19495:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948a7ccad800 3 00010000:00080000:1.0:1788813286.558427:0:19495:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9489436eb000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788813286.567379:0:19495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788813286.573478:0:19495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788813286.576249:0:19495:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788813286.576263:0:19495:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf32533d6ff703e38 00000100:00080000:1.0:1788813286.576274:0:19495:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813286.576285:0:19495:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9489436eb000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788813286.576322:0:19495:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9489435b3100 x1875706313363584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813286.576352:0:19495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788813286.576378:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813286.576383:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813286.576386:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813286.576389:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788813286.576968:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1875706313363584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788813286.577038:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.577156:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313363584 00000100:00100000:1.0:1788813286.577164:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313363584 00000100:00100000:1.0:1788813286.577202:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813286.577218:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1875706313363584:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788813286.577246:0:17164:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:1.0:1788813286.577292:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf32533d6ff703e3f 00000004:00100000:1.0:1788813286.577308:0:17164:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788813286.577340:0:17164:0:(import.c:65:import_set_state_nolock()) ffff9489436ee000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813286.577396:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875706313363584:12345-0@lo:38:llog_process_th.0 Request processed in 177us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.577405:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788813286.577445:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9489435b3100 x1875706313363584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813286.577455:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813286.577462:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788813286.577469:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788813286.577473:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788813286.577475:0:3624:0:(import.c:65:import_set_state_nolock()) ffff9489436eb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788813286.577550:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1875706313363584:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788813286.579927:0:19495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788813286.580263:0:19482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788813286.580296:0:19482:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788813286.580317:0:19482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703e15 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.580329:0:19482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a43dad000/0xf32533d6ff703e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703e15 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788813286.580382:0:19482:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788813286.580385:0:19482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813286.580386:0:19482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813286.580387:0:19482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813286.580389:0:19482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813286.580390:0:19482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813286.580391:0:19482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813286.580393:0:19482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813286.580394:0:19482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813286.580399:0:19482:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788813286.580401:0:19482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788813286.580402:0:19482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813286.580408:0:19482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813286.580409:0:19482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813286.580410:0:19482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813286.580411:0:19482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813286.580412:0:19482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813286.580413:0:19482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813286.580414:0:19482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813286.580441:0:19482:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788813286.580467:0:19482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313363712:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788813286.580555:0:19482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813286.580599:0:19482:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a50590480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813286.580747:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313363712 00000100:00100000:0.0:1788813286.580756:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313363712 00000100:00100000:0.0:1788813286.580821:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788813286.580832:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+24:19482:x1875706313363712:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788813286.580861:0:17157:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788813286.580876:0:17157:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788813286.596296:0:17157:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788813286.596311:0:17157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788813286.596803:0:17178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 00000100:00100000:1.0:1788813286.596804:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+24:19482:x1875706313363712:12345-0@lo:253:mount.lustre.0 Request processed in 15968us (16243us total) trans 0 rc 0/0 10000000:01000000:2.0:1788813286.596817:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1788813286.596818:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:2.0:1788813286.596838:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703e46 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.596855:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a6fc08000/0xf32533d6ff703dba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703db3 expref: 23 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.596863:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948943657c00/0xf32533d6ff703dc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703dc1 expref: 23 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.596870:0:17178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703e46 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.596910:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948943657c00/0xf32533d6ff703dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff703dc1 expref: 23 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.596926:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948943657c00/0xf32533d6ff703dc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff703dc1 expref: 23 pid: 17156 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813286.596963:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875706313363840:0@lo:104: 00000100:00100000:2.0:1788813286.597005:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813286.597064:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a6fc08000/0xf32533d6ff703dba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff703db3 expref: 23 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.597073:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a6fc08000/0xf32533d6ff703dba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff703db3 expref: 23 pid: 17156 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813286.597082:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875706313363968:0@lo:104: 00000100:00100000:2.0:1788813286.597106:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.597211:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313363840 00000100:00100000:1.0:1788813286.597222:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313363840 00000100:00100000:3.0:1788813286.597273:0:19482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7e65740-fccd-471b-95df-6f83776cc95f:19482:1875706313363712:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788813286.597288:0:19482:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788813286.597291:0:19482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788813286.597293:0:19482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788813286.597295:0:19482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813286.597296:0:19482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813286.597298:0:19482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813286.597299:0:19482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813286.597301:0:19482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813286.597303:0:19482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813286.597304:0:19482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788813286.597318:0:19482:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788813286.597363:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313363968 00000100:00100000:1.0:1788813286.597368:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313363968 00000100:00100000:1.0:1788813286.597384:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813286.597392:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76406d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7e65740-fccd-471b-95df-6f83776cc95f+4:17178:x1875706313363840:12345-0@lo:104: 00010000:00010000:1.0:1788813286.597413:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a43dada00/0xf32533d6ff703dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703dc8 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813286.597465:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a488cb240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813286.597478:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875706313363840:0@lo:104: 00010000:00010000:1.0:1788813286.597485:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813286.597491:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76406d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7e65740-fccd-471b-95df-6f83776cc95f+4:17178:x1875706313363840:12345-0@lo:104: Request processed in 100us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.597497:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813286.597513:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813286.597520:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7e65740-fccd-471b-95df-6f83776cc95f+3:17178:x1875706313363968:12345-0@lo:104: 00010000:00010000:1.0:1788813286.597528:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703dba expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.597574:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813286.597579:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7e65740-fccd-471b-95df-6f83776cc95f+3:17178:x1875706313363968:12345-0@lo:104: Request processed in 61us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.597585:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788813286.597604:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813286.597611:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a43dada00/0xf32533d6ff703dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703dc8 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.597617:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dada00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813286.597621:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a43dada00/0xf32533d6ff703dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff703dc8 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.597629:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a43dada00/0xf32533d6ff703dc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff703dc8 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813286.597636:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a43dada00/0xf32533d6ff703dc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff703dc8 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813286.597648:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813286.597679:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a43dada00/0xf32533d6ff703dc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703dc8 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.597687:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813286.597712:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a43dada00/0xf32533d6ff703dc1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703dc8 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.597720:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a43dada00/0xf32533d6ff703dc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703dc8 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.597736:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813286.597739:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703dba expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.597851:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac800 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813286.597855:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff703dba expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.597863:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703db3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff703dba expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813286.597870:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703db3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff703dba expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813286.597875:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813286.597890:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703db3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703dba expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.597896:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813286.597921:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703db3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703dba expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.597928:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a43dac800/0xf32533d6ff703db3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703dba expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.597970:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813286.597972:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813286.597974:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813286.597981:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813286.598003:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313364096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813286.598036:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.598071:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313364224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813286.598095:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.598145:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313364096 00000100:00100000:1.0:1788813286.598151:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313364096 00010000:00010000:1.0:1788813286.598172:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948943657c00/0xf32533d6ff703dc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703dc1 expref: 24 pid: 17156 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813286.598206:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313364224 00000100:00100000:1.0:1788813286.598210:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313364224 00010000:00010000:1.0:1788813286.598222:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a6fc08000/0xf32533d6ff703dba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703db3 expref: 25 pid: 17156 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813286.598235:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813286.598252:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7e65740-fccd-471b-95df-6f83776cc95f+25:3628:x1875706313364096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813286.598278:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813286.598284:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948943657c00/0xf32533d6ff703dc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703dc1 expref: 25 pid: 17156 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.598304:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948943657c00/0xf32533d6ff703dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff703dc1 expref: 25 pid: 17156 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.598317:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948943657c00/0xf32533d6ff703dc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff703dc1 expref: 25 pid: 17156 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.598329:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813286.598359:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7e65740-fccd-471b-95df-6f83776cc95f+24:3628:x1875706313364096:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.598367:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813286.598381:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813286.598388:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7e65740-fccd-471b-95df-6f83776cc95f+23:3625:x1875706313364224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813286.598396:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813286.598401:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a6fc08000/0xf32533d6ff703dba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703db3 expref: 23 pid: 17156 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.598410:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a6fc08000/0xf32533d6ff703dba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff703db3 expref: 23 pid: 17156 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.598423:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703e46 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.598433:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703e46 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788813286.598449:0:17149:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002333126s 00010000:00010000:1.0:1788813286.598454:0:17149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703e46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.598472:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703e46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.598480:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703e46 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.598487:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703e46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.598492:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813286.598497:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703e46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.598505:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703e46 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.598515:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703e46 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.598526:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813286.598554:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7e65740-fccd-471b-95df-6f83776cc95f+23:3625:x1875706313364224:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.598560:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813286.598600:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313364224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813286.598622:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313364096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813286.598897:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc08000/0xf32533d6ff703dba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff703db3 expref: 22 pid: 17156 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813286.598906:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875706313363968:0@lo:104: 00010000:00010000:2.0:1788813286.598919:0:17178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703e46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.598925:0:17178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703e46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.598945:0:17178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703e46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.598952:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc09400/0xf32533d6ff703e46 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788813286.610091:0:19482:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788813286.619403:0:19482:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788813286.619413:0:19482:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788813286.619446:0:19482:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788813286.619511:0:19482:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.113@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788813286.619535:0:19482:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788813286.619564:0:19482:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788813286.621635:0:19482:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788813286.621952:0:19482:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788813286.756521:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313364352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788813286.756590:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813286.756736:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313364352 00000100:00100000:3.0:1788813286.756745:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313364352 00000100:00100000:3.0:1788813286.756801:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788813286.756811:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313364352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788813286.756850:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788813286.756899:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313364352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813286.756905:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788813286.759081:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313364480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813286.759151:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.759235:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313364352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813286.760363:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313364480 00000100:00100000:0.0:1788813286.760376:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313364480 00000100:00100000:0.0:1788813286.760428:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788813286.760437:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313364480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788813286.760495:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788813286.760572:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313364480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813286.760579:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788813286.761659:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313364480:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788813286.823749:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788813287.588794:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788813287.653891:0:17160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788813287.653900:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948a7b569800 from 10 10000000:01000000:3.0:1788813287.653905:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788813287.653977:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813287.653989:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813287.654002:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813287.654039:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313364608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813287.654115:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813287.654174:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6eb2de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813287.654444:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313364608 00000100:00100000:0.0:1788813287.654454:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313364608 00000100:00100000:0.0:1788813287.654525:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788813287.654535:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+22:17160:x1875706313364608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813287.654549:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813287.654607:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cdba00/0xf32533d6ff703e54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703e4d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813287.654635:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdba00/0xf32533d6ff703e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703e4d expref: 23 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813287.654647:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cdba00/0xf32533d6ff703e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703e4d expref: 23 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813287.654657:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdba00, rc 0) 00000100:00100000:0.0:1788813287.654712:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+23:17160:x1875706313364608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813287.654719:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788813287.654821:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313364608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813287.654846:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703e54 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813287.654855:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703e54 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813287.654917:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313364736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788813287.654973:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813287.654996:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7fe9e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813287.657402:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313364736 00000100:00100000:0.0:1788813287.657417:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313364736 00000100:00100000:0.0:1788813287.657483:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788813287.657496:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:17160:x1875706313364736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788813287.657526:0:17157:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788813287.657543:0:17157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788813287.657546:0:17157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788813287.657679:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:17160:x1875706313364736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 186us (2704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813287.657686:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788813287.657753:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313364736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788813287.657823:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788813287.657832:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703e54 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813287.657843:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948943656800/0xf32533d6ff703e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703e54 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813287.657860:0:17160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788813287.657863:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9489437db000 from 10 10000000:01000000:0.0:1788813287.657865:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788813287.657892:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813287.657900:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813287.657909:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813287.657929:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313364864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813287.657977:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813287.658003:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a74a5a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788813287.658018:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313364864 00000100:00100000:0.0:1788813287.658022:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313364864 00000100:00100000:0.0:1788813287.658043:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788813287.658049:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+23:17160:x1875706313364864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813287.658058:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813287.658069:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff703e62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff703e5b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813287.658091:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff703e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff703e5b expref: 24 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813287.658102:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cdbe00/0xf32533d6ff703e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703e5b expref: 24 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813287.658121:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdbe00, rc 0) 00000100:00100000:0.0:1788813287.658151:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+24:17160:x1875706313364864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813287.658158:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788813287.658189:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313364864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813287.658201:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703e62 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813287.658210:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff703e62 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813287.658250:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894423b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313364992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788813287.658511:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813287.658525:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a74a5a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788813287.658536:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313364992 00000100:00100000:0.0:1788813287.658540:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313364992 00000100:00100000:0.0:1788813287.658558:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788813287.658563:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+24:17160:x1875706313364992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788813287.658573:0:17156:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788813287.658586:0:17156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788813287.658589:0:17156:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788813287.658650:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+24:17160:x1875706313364992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 86us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813287.658657:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788813287.658685:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894423b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313364992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788813287.658726:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788813287.658905:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703e62 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813287.658914:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a44cda400/0xf32533d6ff703e5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff703e62 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1788813287.747429:0:19550:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788813287.747701:0:19550:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788813287.845127:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813288.612608:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813268/real 1788813268] req@ffff94894424f100 x1875706313350528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813288 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813288.612651:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94894424f100 x1875706313350528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813288 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813288.612661:0:3624:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813268/real 1788813268] req@ffff94894424ea00 x1875706313350656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813288 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813288.612673:0:3624:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94894424ea00 x1875706313350656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813288 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788813288.612696:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a611ab800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788813288.612738:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788813288.612743:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313350528:0@lo:8:kworker.0 00000100:00080000:0.0:1788813288.612749:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a507c3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788813288.612755:0:3624:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788813288.612758:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894424ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313350656:0@lo:8:kworker.0 00000100:00100000:3.0:1788813288.613165:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313365120:0@lo:400:kworker.0 00000100:00100000:3.0:1788813288.613258:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813288.613355:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313365120 00000100:00100000:0.0:1788813288.613366:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313365120 00000100:00100000:0.0:1788813288.613417:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788813288.613427:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+24:3628:x1875706313365120:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788813288.614198:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813288.614203:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788813288.614207:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a611ab800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813288.614213:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 421 00000100:00080000:2.0:1788813288.614217:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788813288.614227:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff948a611ab800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813288.614248:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a76406680 x1875706313365376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788813288.614263:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813288.614266:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788813288.614268:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a507c3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813288.614271:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 421 00000100:00080000:2.0:1788813288.614274:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788813288.614278:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff948a507c3800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813288.614289:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a76405f80 x1875706313365504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788813288.614361:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313365760:0@lo:400:kworker.0 00000100:00100000:1.0:1788813288.614432:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813288.614492:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313365632:0@lo:400:kworker.0 00000100:00100000:1.0:1788813288.614521:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813288.614542:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813288.614548:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313365248:0@lo:400:kworker.0 00000100:00100000:1.0:1788813288.614569:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813288.614611:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313365760 00000100:00100000:1.0:1788813288.614617:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313365760 00000100:00100000:1.0:1788813288.614658:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313365248 00000100:00100000:1.0:1788813288.614661:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313365248 00000100:00100000:1.0:1788813288.614675:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788813288.614683:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313365760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813288.614750:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313365760:12345-0@lo:400:kworker.0 Request processed in 67us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813288.614757:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788813288.614795:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788813288.614801:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313365248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813288.614835:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313365248:12345-0@lo:400:kworker.0 Request processed in 34us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813288.614840:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788813288.614869:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313365632 00000100:00100000:1.0:1788813288.614873:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313365632 00000100:00100000:1.0:1788813288.614899:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813288.614905:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313365632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813288.614967:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875706313365632:12345-0@lo:400:kworker.0 Request processed in 62us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813288.614973:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813288.615015:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313365760:0@lo:400:kworker.0 00000100:00100000:1.0:1788813288.615042:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313365248:0@lo:400:kworker.0 00010000:00080000:1.0:1788813288.615052:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76404700 x1875706313365632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813288.615062:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875706313365632:0@lo:400:kworker.0 00000100:00100000:0.0:1788813288.615422:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+24:3628:x1875706313365120:12345-0@lo:400:kworker.0 Request processed in 1994us (2162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813288.615430:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788813288.618852:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313365376:0@lo:8:kworker.0 00000100:00100000:0.0:1788813288.618958:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813288.619014:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313365504:0@lo:8:kworker.0 00000100:00100000:0.0:1788813288.619040:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813288.619327:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313365376 00000100:00100000:1.0:1788813288.619342:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313365376 00000100:00100000:1.0:1788813288.619380:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313365504 00000100:00100000:1.0:1788813288.619383:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313365504 00000100:00100000:1.0:1788813288.619417:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813288.619425:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3624:x1875706313365376:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788813288.619477:0:19191:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:1.0:1788813288.619519:0:19191:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff703e69 00002000:00100000:1.0:1788813288.619551:0:19191:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9489436ed000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788813288.619555:0:19191:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788813288.619558:0:19191:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788813288.619650:0:19191:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788813288.619677:0:19191:0:(import.c:65:import_set_state_nolock()) ffff9489436e9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813288.619924:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3624:x1875706313365376:12345-0@lo:8:kworker.0 Request processed in 497us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813288.619956:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813288.619976:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813288.619981:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3624:x1875706313365504:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788813288.619999:0:19191:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:1.0:1788813288.620014:0:19191:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf32533d6ff703e70 00002000:00100000:1.0:1788813288.620020:0:19191:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9489436ef800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788813288.620024:0:19191:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788813288.620026:0:19191:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788813288.620205:0:19191:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788813288.620219:0:19191:0:(import.c:65:import_set_state_nolock()) ffff9489436ea000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813288.620252:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3624:x1875706313365504:12345-0@lo:8:kworker.0 Request processed in 269us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813288.620258:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788813288.620544:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813288.620550:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788813288.620553:0:36:0:(import.c:65:import_set_state_nolock()) ffff948a7b790000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813288.620566:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff948a7b790000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788813288.620589:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948a76405880 x1875706313366016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813288.620661:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313366144:0@lo:400:kworker.0 00000100:00100000:2.0:1788813288.620699:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813288.620958:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313366656:0@lo:400:kworker.0 00000100:00100000:2.0:1788813288.620991:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813288.621016:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813288.621022:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313366272:0@lo:400:kworker.0 00000100:00100000:2.0:1788813288.621045:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813288.621087:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313366144 00000100:00100000:2.0:1788813288.621093:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313366144 00000100:00100000:2.0:1788813288.621132:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313366656 00000100:00100000:2.0:1788813288.621135:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313366656 00000100:00100000:2.0:1788813288.621159:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313366272 00000100:00100000:2.0:1788813288.621162:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313366272 00000100:00100000:2.0:1788813288.621176:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788813288.621183:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313366144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813288.621223:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313366144:12345-0@lo:400:kworker.0 Request processed in 41us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813288.621230:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788813288.621244:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788813288.621262:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313366656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813288.621290:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313366656:12345-0@lo:400:kworker.0 Request processed in 29us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813288.621295:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788813288.621306:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788813288.621311:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313366272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813288.621334:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313366272:12345-0@lo:400:kworker.0 Request processed in 23us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813288.621341:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788813288.621365:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813288.621370:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788813288.621405:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76404a80 x1875706313366272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813288.621417:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313366272:0@lo:400:kworker.0 00010000:00080000:2.0:1788813288.621430:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76407800 x1875706313366144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813288.621439:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313366144:0@lo:400:kworker.0 00010000:00080000:2.0:1788813288.621449:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76406300 x1875706313366656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813288.621457:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313366656:0@lo:400:kworker.0 00000100:00100000:1.0:1788813288.621627:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313366400:0@lo:400:kworker.0 00000100:00100000:1.0:1788813288.621658:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813288.621679:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788813288.621684:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313365888:0@lo:400:kworker.0 00000100:00100000:1.0:1788813288.621706:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813288.621722:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313366528:0@lo:400:kworker.0 00000100:00100000:0.0:1788813288.621870:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313365888 00000100:00100000:0.0:1788813288.621875:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313365888 00000100:00100000:0.0:1788813288.621913:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813288.621919:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313365888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813288.621971:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313365888:12345-0@lo:400:kworker.0 Request processed in 53us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813288.621978:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813288.622001:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313366016:0@lo:8:kworker.0 00000100:00100000:0.0:1788813288.622027:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788813288.622053:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76406680 x1875706313365376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813288.622061:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788813288.622068:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788813288.622078:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788813288.622083:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788813288.622086:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a611ab800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788813288.622099:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788813288.622104:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313365376:0@lo:8:kworker.0 00010000:00080000:0.0:1788813288.622129:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76405f80 x1875706313365504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813288.622136:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788813288.622141:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788813288.622146:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788813288.622149:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788813288.622151:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a507c3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788813288.622162:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788813288.622165:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1875706313365504:0@lo:8:kworker.0 00000100:00100000:0.0:1788813288.622212:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313366400 00000100:00100000:0.0:1788813288.622215:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313366400 00000100:00100000:0.0:1788813288.622240:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788813288.622246:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313366400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813288.622278:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313366400:12345-0@lo:400:kworker.0 Request processed in 32us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813288.622284:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788813288.622303:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313366016 00000100:00100000:0.0:1788813288.622306:0:18671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313366016 00000100:00100000:0.0:1788813288.622319:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788813288.622323:0:18671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3624:x1875706313366016:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788813288.622348:0:18671:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:0.0:1788813288.622373:0:18671:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf32533d6ff703e77 00002000:00100000:0.0:1788813288.622384:0:18671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff948a6ae45000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788813288.622388:0:18671:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788813288.622390:0:18671:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788813288.622454:0:18671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788813288.622498:0:18671:0:(import.c:65:import_set_state_nolock()) ffff948a6ae40000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813288.622537:0:18671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3624:x1875706313366016:12345-0@lo:8:kworker.0 Request processed in 212us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813288.622545:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000004:00080000:0.0:1788813288.622596:0:17187:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788813288.622614:0:17187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46547100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17187:1875706313366912:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788813288.622637:0:17187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813288.622651:0:17187:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6ecdb540 going to sleep for 11 seconds 00010000:00080000:0.0:1788813288.622671:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76405880 x1875706313366016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788813288.622680:0:3624:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788813288.622684:0:3624:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788813288.622687:0:3624:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788813288.622689:0:3624:0:(import.c:65:import_set_state_nolock()) ffff948a7b790000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788813288.622702:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788813288.622706:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1875706313366016:0@lo:8:kworker.0 00000100:00100000:0.0:1788813288.622722:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313366912 00000100:00100000:0.0:1788813288.622739:0:18671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313366912 00000100:00100000:0.0:1788813288.622774:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788813288.622780:0:18671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17187:x1875706313366912:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788813288.623082:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313366784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813288.623126:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813288.623169:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313366784 00000100:00100000:0.0:1788813288.623173:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313366784 00000100:00100000:0.0:1788813288.623199:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813288.623205:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1875706313366784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813288.623232:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788813288.623270:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1875706313366784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813288.623276:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788813288.623307:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a46545180 x1875706313366784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813288.623321:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313366784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788813288.623340:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788813288.623344:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813288.623881:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788813288.623910:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76405180 x1875706313366400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813288.623919:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313366400:0@lo:400:kworker.0 00010000:00080000:1.0:1788813288.623971:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76404380 x1875706313365888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813288.624195:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313365888:0@lo:400:kworker.0 00000004:00080000:1.0:1788813288.624223:0:17186:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788813288.624308:0:17186:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 441643375426ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788813288.624316:0:17186:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788813288.624376:0:17189:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1788813288.624396:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17189:1875706313367168:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788813288.624430:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813288.624445:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a43dbc900 going to sleep for 11 seconds 00000004:00080000:1.0:1788813288.624456:0:17188:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788813288.624583:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313365120:0@lo:400:kworker.0 00000100:00100000:3.0:1788813288.624600:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813288.624613:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313367168 00000100:00100000:3.0:1788813288.624618:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313367168 00000100:00100000:3.0:1788813288.624653:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813288.624661:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17189:x1875706313367168:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788813288.624885:0:17907:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788813288.624901:0:17907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccfad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17907:1875706313367424:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788813288.624958:0:17907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813288.624970:0:17907:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6eb2d0c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788813288.624982:0:17906:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788813288.625201:0:17906:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 441644268660ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788813288.625207:0:17906:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788813288.625272:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313367040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813288.625303:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813288.625322:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a7ccf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313367296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813288.625340:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788813288.626678:0:17188:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441645743700ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788813288.626690:0:17188:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788813288.627588:0:19191:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788813288.627600:0:19191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788813288.628306:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313366528 00000100:00100000:3.0:1788813288.628323:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313366528 00000100:00100000:3.0:1788813288.628387:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788813288.628397:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313366528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813288.628501:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313366528:12345-0@lo:400:kworker.0 Request processed in 106us (4620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813288.628508:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788813288.628982:0:18670:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788813288.628993:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313367424 00000100:00100000:0.0:1788813288.628998:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313367424 00000100:00100000:0.0:1788813288.629033:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313367040 00000100:00100000:0.0:1788813288.629036:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313367040 00000100:00100000:0.0:1788813288.629050:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313367296 00000100:00100000:0.0:1788813288.629052:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313367296 00000100:00100000:0.0:1788813288.629064:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813288.629071:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1875706313367040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813288.629094:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788813288.629146:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1875706313367040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (3842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813288.629152:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813288.629165:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788813288.629171:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3628:x1875706313367296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788813288.629181:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788813288.629207:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3628:x1875706313367296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (3865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813288.629226:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788813288.630016:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813288.630024:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788813288.630065:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccf9500 x1875706313367296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813288.630092:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313367296:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788813288.630105:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489435b3800 x1875706313367040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813288.630116:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489435b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313367040:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788813288.631101:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76404700 x1875706313366528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813288.631114:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313366528:0@lo:400:kworker.0 00002000:00080000:1.0:1788813288.635840:0:18671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788813288.635857:0:18671:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788813288.635865:0:18671:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000100:00100000:0.0:1788813288.639684:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813288.639709:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17907:x1875706313367424:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788813288.651076:0:17142:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788813288.651115:0:17142:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788813288.654779:0:18668:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788813288.654791:0:18668:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788813288.654801:0:18668:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:2.0:1788813288.655557:0:19582:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788813288.655564:0:19582:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788813288.655662:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17907:x1875706313367424:12345-0@lo:7:osp-pre-1-1.0 Request processed in 15961us (30699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813288.655679:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788813288.656609:0:17907:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a7ccfad80 x1875706313367424/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788813304 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813288.656626:0:17907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a7ccfad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17907:1875706313367424:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788813288.656642:0:17907:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788813288.656687:0:17907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17907:1875706313367552:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788813288.656746:0:17907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813288.656790:0:17907:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a7fe9e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813288.656800:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313367552 00000100:00100000:0.0:1788813288.656808:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313367552 00000100:00100000:0.0:1788813288.656855:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813288.656864:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17907:x1875706313367552:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788813288.656890:0:18670:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788813288.656959:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17907:x1875706313367552:12345-0@lo:5:osp-pre-1-1.0 Request processed in 67us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813288.656967:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788813288.656999:0:17907:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76406300 x1875706313367552/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813304 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813288.657008:0:17907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17907:1875706313367552:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788813288.657018:0:17907:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788813288.657053:0:17907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46545180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17907:1875706313367680:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788813288.657077:0:17907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813288.657099:0:17907:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a45939240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813288.657100:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313367680 00000100:00100000:2.0:1788813288.657104:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313367680 00000100:00100000:2.0:1788813288.657134:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788813288.657540:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17907:x1875706313367680:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788813288.657570:0:19582:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:1.0:1788813288.666428:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813288.666453:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cd0256d/0xf32533d6ff703e7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.667595:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788813288.667601:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813288.667608:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cd0256d/0xf32533d6ff703e7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.667631:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cd0256d/0xf32533d6ff703e7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.667643:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cd0256d/0xf32533d6ff703e7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.667651:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cd0256d/0xf32533d6ff703e7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.667672:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813288.667687:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.667692:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cd0256d/0xf32533d6ff703e7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.667699:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43daca00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.667704:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cd0256d/0xf32533d6ff703e7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.667712:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cd0256d/0xf32533d6ff703e7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.667888:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cd0256d/0xf32533d6ff703e7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.667898:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cd0256d/0xf32533d6ff703e7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.667921:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.667923:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.667925:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813288.669667:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813288.669678:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c90571f/0xf32533d6ff703e85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.669694:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788813288.669699:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813288.669704:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c90571f/0xf32533d6ff703e85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.669717:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c90571f/0xf32533d6ff703e85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.669734:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c90571f/0xf32533d6ff703e85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.669742:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c90571f/0xf32533d6ff703e85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.669787:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788813288.672356:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813288.672369:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703e8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.672388:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788813288.672392:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813288.672398:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703e8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.672413:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703e8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.672424:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703e8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.672434:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703e8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.672453:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788813288.673188:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813288.673196:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c90571f/0xf32533d6ff703e85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.673206:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dadc00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.673219:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c90571f/0xf32533d6ff703e85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.673229:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c90571f/0xf32533d6ff703e85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.673248:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c90571f/0xf32533d6ff703e85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.673255:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c90571f/0xf32533d6ff703e85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.673279:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.673282:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703e8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.673289:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.673292:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703e8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.673300:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703e8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.673310:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703e8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.673318:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d38c805e/0xf32533d6ff703e8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.673339:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.673341:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.673343:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813288.675666:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813288.675682:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009f7e44c/0xf32533d6ff703e93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.675699:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788813288.675704:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813288.675710:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009f7e44c/0xf32533d6ff703e93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.675724:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009f7e44c/0xf32533d6ff703e93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.675893:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009f7e44c/0xf32533d6ff703e93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.675901:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009f7e44c/0xf32533d6ff703e93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.675920:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813288.675971:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.675977:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009f7e44c/0xf32533d6ff703e93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.676000:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dada00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.676005:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009f7e44c/0xf32533d6ff703e93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.676015:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009f7e44c/0xf32533d6ff703e93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.676031:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009f7e44c/0xf32533d6ff703e93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.676039:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009f7e44c/0xf32533d6ff703e93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.676059:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.676061:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.676063:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813288.679092:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813288.679106:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff703e9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.679126:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788813288.679131:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813288.679137:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff703e9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.679152:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff703e9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.679171:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff703e9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.679177:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff703e9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.679200:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813288.679216:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.679221:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff703e9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.679229:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dac800 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.679234:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff703e9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.679243:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff703e9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.679261:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff703e9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.679270:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009de4193a/0xf32533d6ff703e9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.679289:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.679298:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.679300:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813288.680048:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813288.680056:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ea1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.680067:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788813288.680070:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813288.680075:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.680085:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.680094:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.680101:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.680115:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813288.680122:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.680126:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.680132:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.680136:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.680156:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.680167:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ea1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.680175:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ea1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.680190:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.680192:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.680194:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.680410:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788813288.681227:0:17895:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:1.0:1788813288.682645:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813288.682655:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ea8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.682670:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788813288.682675:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813288.682681:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ea8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.682695:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ea8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.682706:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ea8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.682719:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.682735:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813288.682746:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.682752:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.682759:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.682777:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.682786:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ea8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.682802:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ea8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813288.682983:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813288.682990:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703eaf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.682998:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1788813288.683002:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813288.683005:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.683018:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.683025:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.683033:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.683054:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813288.683062:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813288.683274:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.683280:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.683288:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813288.683291:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.683300:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703eaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.683312:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703eaf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.683320:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703eaf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.683334:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.683336:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.683337:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.683341:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.683343:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.683660:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ea8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.683679:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.683680:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.683682:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813288.685686:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813288.685697:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703eb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.685713:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788813288.685719:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813288.685732:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.685749:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.685784:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.685793:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.686568:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813288.686584:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813288.686590:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.686601:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813288.686606:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.686616:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.686633:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703eb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.686642:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067e29a52/0xf32533d6ff703eb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.686657:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.686665:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.686667:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813288.689084:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813288.689097:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff703ebd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.689114:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788813288.689119:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813288.689125:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff703ebd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.689140:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff703ebd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.689151:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff703ebd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.689160:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff703ebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.689184:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813288.689336:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813288.689342:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff703ebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.689351:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813288.689355:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff703ebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.689378:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff703ebd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.689396:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff703ebd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.689402:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000706d62cc/0xf32533d6ff703ebd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.689419:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.689421:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.689423:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813288.690588:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.690597:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ec4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.690612:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.690616:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.690622:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ec4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.690637:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ec4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.690646:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ec4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.690654:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ec4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.690682:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813288.690772:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813288.690779:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ec4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.690788:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdac00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813288.690793:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ec4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.690801:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ec4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.690830:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ec4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.690847:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ec4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.690865:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.690867:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.690868:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813288.695887:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813288.695898:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703ecb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.695920:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1788813288.695925:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813288.695945:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703ecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.695960:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703ecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.695973:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703ecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.695981:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703ecb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.696001:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813288.696140:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813288.696147:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703ecb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.696155:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657800 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813288.696161:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703ecb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.696170:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703ecb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.696196:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703ecb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.696204:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703ecb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.696221:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.696222:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.696224:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813288.696605:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813288.696621:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ed2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.696630:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788813288.696633:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813288.696638:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.696648:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.696656:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.696663:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.696685:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813288.697234:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813288.697241:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.697251:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813288.697255:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.697263:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ed2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.697277:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ed2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.697285:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000232a47af/0xf32533d6ff703ed2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.697299:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.697300:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.697302:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813288.697567:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813288.697573:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ed9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.697582:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788813288.697586:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813288.697591:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.697600:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.697613:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.697620:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.697641:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813288.698109:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813288.698115:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.698122:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813288.698125:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.698133:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ed9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.698145:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ed9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.698153:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f2fb93/0xf32533d6ff703ed9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.698174:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.698175:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.698177:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813288.700544:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813288.700567:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005caf7fd8/0xf32533d6ff703ee0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.700585:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788813288.700591:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813288.700596:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005caf7fd8/0xf32533d6ff703ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.700614:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005caf7fd8/0xf32533d6ff703ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.700624:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005caf7fd8/0xf32533d6ff703ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.700631:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005caf7fd8/0xf32533d6ff703ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.700678:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813288.700691:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.700697:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005caf7fd8/0xf32533d6ff703ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.700704:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8c00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.700709:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005caf7fd8/0xf32533d6ff703ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.700717:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005caf7fd8/0xf32533d6ff703ee0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.700748:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005caf7fd8/0xf32533d6ff703ee0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.700756:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005caf7fd8/0xf32533d6ff703ee0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.700783:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.700785:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.700787:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813288.701355:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.701363:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ee7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.701373:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.701382:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.701387:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ee7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.701398:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ee7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.701406:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ee7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.701414:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ee7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.701437:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813288.704200:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.704214:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ee7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.704228:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdbc00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.704239:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ee7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.704251:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ee7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.704276:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ee7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.704283:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ee7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.704304:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.704306:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.704308:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813288.704340:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.704349:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703eee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.704362:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.704366:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.704370:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703eee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.704383:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703eee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.704391:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703eee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.704406:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703eee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.704431:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788813288.704705:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813288.704711:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec60f5b/0xf32533d6ff703ef5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.704719:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788813288.704722:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813288.704732:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec60f5b/0xf32533d6ff703ef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.704753:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec60f5b/0xf32533d6ff703ef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.704770:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec60f5b/0xf32533d6ff703ef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.704778:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec60f5b/0xf32533d6ff703ef5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.704800:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788813288.705247:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813288.705253:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703eee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.705262:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.705265:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703eee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.705275:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703eee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.705288:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703eee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.705304:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703eee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.705320:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.705324:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec60f5b/0xf32533d6ff703ef5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.705329:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08800 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.705332:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec60f5b/0xf32533d6ff703ef5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.705339:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec60f5b/0xf32533d6ff703ef5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.705349:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec60f5b/0xf32533d6ff703ef5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.705355:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec60f5b/0xf32533d6ff703ef5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.705367:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.705369:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.705370:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813288.705991:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813288.705998:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff703efc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.706016:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788813288.706020:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813288.706025:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff703efc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.706037:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff703efc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.706046:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff703efc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.706054:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff703efc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.706073:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813288.706280:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813288.706287:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff703efc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.706295:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813288.706299:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff703efc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.706308:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff703efc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.706324:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff703efc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.706331:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6d3b335/0xf32533d6ff703efc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.706351:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.706352:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.706354:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813288.707120:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813288.707128:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff703f03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.707140:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788813288.707143:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813288.707148:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff703f03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.707161:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff703f03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.707183:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff703f03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.707190:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff703f03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.707207:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813288.707265:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.707277:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707285:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.707288:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.707292:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707301:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707308:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707315:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707328:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788813288.707335:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813288.707340:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff703f03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707346:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813288.707349:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff703f03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707356:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff703f03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.707386:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813288.707386:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff703f03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.707391:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707394:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068b2eed3/0xf32533d6ff703f03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.707399:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdaa00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.707402:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.707409:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707410:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.707411:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.707413:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.707420:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f0a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.707427:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.707440:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.707450:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.707451:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813288.707836:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.707843:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707851:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.707854:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.707857:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707867:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707875:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707882:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707906:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813288.707913:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813288.707917:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707923:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813288.707927:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707954:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813288.707959:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813288.707964:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff703f18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707965:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.707972:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.707973:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.707976:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813288.707980:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff703f18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707987:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.707989:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff703f18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.707989:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.707990:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.707996:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff703f18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.708003:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff703f18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.708016:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813288.708084:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.708090:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff703f18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.708097:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9800 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.708101:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff703f18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.708120:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff703f18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.708132:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff703f18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.708140:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a000737a/0xf32533d6ff703f18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.708153:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.708155:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.708156:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.708253:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813288.709006:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813288.709012:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.709028:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788813288.709032:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813288.709036:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.709047:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.709056:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.709071:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.709085:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813288.712233:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.712248:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.712262:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.712267:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.712279:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.712300:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.712308:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.712337:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.712339:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.712341:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813288.718700:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813288.718713:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703f26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.718737:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788813288.718742:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813288.718749:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703f26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.718773:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703f26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.718786:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703f26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.718805:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703f26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.719582:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813288.719631:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813288.719639:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703f26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.719648:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813288.719659:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703f26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.719669:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703f26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.719685:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703f26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.719692:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000706d62cc/0xf32533d6ff703f26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.719709:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.719711:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.719712:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788813288.720061:0:19483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788813288.720079:0:19483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788813288.720083:0:19483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1788813288.721110:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813288.721122:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067e29a52/0xf32533d6ff703f2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.721139:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788813288.721143:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813288.721149:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067e29a52/0xf32533d6ff703f2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.721162:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067e29a52/0xf32533d6ff703f2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.721171:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067e29a52/0xf32533d6ff703f2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.721178:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067e29a52/0xf32533d6ff703f2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.721195:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813288.721812:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.721821:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abc12f4b/0xf32533d6ff703f34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.721831:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.721834:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.721838:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abc12f4b/0xf32533d6ff703f34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.721848:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abc12f4b/0xf32533d6ff703f34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.721863:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abc12f4b/0xf32533d6ff703f34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.721870:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abc12f4b/0xf32533d6ff703f34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.721885:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788813288.721958:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813288.721970:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067e29a52/0xf32533d6ff703f2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.721978:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.721982:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067e29a52/0xf32533d6ff703f2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.721991:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067e29a52/0xf32533d6ff703f2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.722006:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067e29a52/0xf32533d6ff703f2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.722014:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067e29a52/0xf32533d6ff703f2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.722030:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.722034:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abc12f4b/0xf32533d6ff703f34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.722040:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.722044:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abc12f4b/0xf32533d6ff703f34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.722051:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abc12f4b/0xf32533d6ff703f34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.722073:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abc12f4b/0xf32533d6ff703f34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.722080:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abc12f4b/0xf32533d6ff703f34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.722093:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.722095:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.722097:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813288.722281:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.722287:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703f3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.722295:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.722298:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.722302:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703f3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.722311:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703f3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.722319:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703f3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.722327:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703f3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.722357:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813288.722595:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.722601:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813288.722605:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.722609:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788813288.722610:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0456d5c/0xf32533d6ff703f49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.722612:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.722616:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.722624:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788813288.722626:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.722626:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.722631:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0456d5c/0xf32533d6ff703f49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.722634:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.722640:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0456d5c/0xf32533d6ff703f49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.722641:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.722648:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0456d5c/0xf32533d6ff703f49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.722653:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788813288.722654:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0456d5c/0xf32533d6ff703f49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.722662:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788813288.722890:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788813288.722895:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703f3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.722902:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdae00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.722905:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703f3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.722913:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703f3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.722925:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703f3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.722956:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703f3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.722981:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813288.722984:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.722991:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdaa00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.722994:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.723001:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.723012:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f42 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.723018:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.723027:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.723031:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0456d5c/0xf32533d6ff703f49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.723036:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.723039:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0456d5c/0xf32533d6ff703f49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.723059:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0456d5c/0xf32533d6ff703f49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.723069:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0456d5c/0xf32533d6ff703f49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.723076:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0456d5c/0xf32533d6ff703f49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.723088:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.723090:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.723091:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.723097:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813288.724057:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:17907:x1875706313367680:12345-0@lo:5:osp-pre-1-1.0 Request processed in 66909us (66971us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788813288.724069:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00002000:00010000:2.0:1788813288.724169:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813288.724176:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.724187:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788813288.724192:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813288.724197:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.724223:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.724232:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.724239:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.724254:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813288.724301:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.724308:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.724316:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.724324:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.724328:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.724337:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.724345:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.724351:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.724361:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788813288.724413:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788813288.724419:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.724427:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813288.724431:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.724440:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.724453:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813288.725986:0:17907:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788813288.726002:0:17907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46545180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17907:1875706313367680:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788813288.726021:0:17907:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788813288.726073:0:17907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17907:1875706313367808:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788813288.726129:0:17907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813288.726158:0:17907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489434aca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813288.726189:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313367808 00000100:00100000:1.0:1788813288.726196:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313367808 00000100:00100000:1.0:1788813288.726243:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813288.726252:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17907:x1875706313367808:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788813288.726301:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17907:x1875706313367808:12345-0@lo:900:osp-pre-1-1.0 Request processed in 50us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813288.726318:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788813288.726343:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.726350:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.726361:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.726366:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.726375:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.726393:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.726401:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.726420:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.726422:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.726423:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788813288.726444:0:17907:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489433a5180 x1875706313367808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788813304 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813288.726455:0:17907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17907:1875706313367808:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788813288.726593:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.726620:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.726621:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.726623:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.727378:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813288.728732:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788813288.728749:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.728774:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788813288.728780:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813288.728786:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.728801:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813288.729683:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813288.729693:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703f65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.729706:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1788813288.729709:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813288.729713:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703f65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.729724:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703f65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.729735:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703f65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.729743:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703f65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.729786:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813288.729841:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813288.729850:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703f65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.729858:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657800 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813288.729863:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703f65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.729873:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703f65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.729889:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703f65 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.729909:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000998d59d4/0xf32533d6ff703f65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.729926:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.729928:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.729943:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.730858:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.730871:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.730898:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813288.731171:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813288.731177:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.731186:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f8e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813288.731190:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.731199:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.731218:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.731226:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000843b3359/0xf32533d6ff703f5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.731245:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.731246:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.731248:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813288.732014:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813288.732023:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703f6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.732036:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1788813288.732048:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813288.732055:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703f6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.732069:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703f6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.732079:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703f6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.732087:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703f6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.732105:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813288.732370:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.732376:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.732384:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.732387:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.732391:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.732400:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.732407:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.732414:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.732435:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788813288.733570:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.733584:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff703f7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.733596:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.733600:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.733604:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff703f7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.733616:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff703f7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.733625:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff703f7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.733633:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff703f7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813288.738154:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813288.738170:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703f81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.738188:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788813288.738193:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813288.738200:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703f81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.738215:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703f81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.738226:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703f81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.738234:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703f81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.738329:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788813288.738338:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703f6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.738347:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.738352:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703f6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.738363:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703f6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.738398:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703f6c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.738406:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703f6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.743019:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788813288.743048:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788813288.743057:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.743070:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813288.743070:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813288.743075:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.743077:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff703f7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.743084:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdbc00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.743087:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff703f7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.743089:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.743093:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff703f7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.743112:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff703f7a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.743117:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.743119:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003109aa10/0xf32533d6ff703f7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.743125:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051d5de17/0xf32533d6ff703f73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.743153:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813288.743159:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703f81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.743165:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813288.743169:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703f81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.743176:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703f81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.743180:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.743185:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703f81 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.743193:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.743194:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.743196:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.743211:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.743213:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.743220:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813288.745277:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.745291:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4510369/0xf32533d6ff703f88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.745314:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.745319:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.745327:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4510369/0xf32533d6ff703f88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.745340:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4510369/0xf32533d6ff703f88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.745351:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4510369/0xf32533d6ff703f88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.745358:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4510369/0xf32533d6ff703f88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.745381:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813288.745415:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813288.745422:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4510369/0xf32533d6ff703f88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.745431:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdac00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813288.745435:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4510369/0xf32533d6ff703f88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.745443:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4510369/0xf32533d6ff703f88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.745459:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4510369/0xf32533d6ff703f88 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.745484:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4510369/0xf32533d6ff703f88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.745501:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.745502:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.745505:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813288.745837:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.745843:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.745851:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.745855:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.745859:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.745868:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.745887:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.745895:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.745917:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813288.746237:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.746243:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.746252:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.746255:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.746259:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.746268:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.746276:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.746283:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.746312:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788813288.746323:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813288.746328:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.746335:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813288.746339:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.746348:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.746362:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.746370:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b1cece7/0xf32533d6ff703f8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.746385:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813288.746388:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.746395:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdaa00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813288.746398:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.746418:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.746429:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.746437:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f84624f/0xf32533d6ff703f96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.746450:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.746452:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.746454:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.747042:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788813288.747049:0:18668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703f81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.747591:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.747599:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813288.748097:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813288.748111:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.748124:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788813288.748128:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813288.748133:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.748145:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.748155:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.748162:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.748187:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813288.748323:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813288.748329:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813288.748329:0:18671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703fa4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.748335:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.748338:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.748341:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813288.748343:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09600 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813288.748345:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.748347:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.748355:0:18671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.748356:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.748364:0:18671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.748371:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f9d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.748379:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081fcfc96/0xf32533d6ff703f9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.748381:0:18671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.748394:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813288.748403:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.748410:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdae00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813288.748413:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.748420:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703fa4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.748431:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703fa4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.748439:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.748441:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.749688:0:18671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788813288.749697:0:18671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0690f24/0xf32533d6ff703fa4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788813288.750127:0:18671:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:0.0:1788813288.750236:0:18671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17187:x1875706313366912:12345-0@lo:5:osp-pre-0-0.0 Request processed in 127452us (127594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813288.750246:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788813288.750300:0:17187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46547100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17187:1875706313366912:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788813288.750314:0:17187:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788813288.750358:0:17187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46547100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17187:1875706313367936:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788813288.750389:0:17187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813288.750410:0:17187:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a4634a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813288.750426:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313367936 00000100:00100000:0.0:1788813288.750432:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313367936 00000100:00100000:0.0:1788813288.750467:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788813288.750475:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17187:x1875706313367936:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788813288.750508:0:19191:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1788813288.754017:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.754100:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813288.754190:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813288.754199:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703fab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.754215:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788813288.754220:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813288.754225:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703fab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.754252:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703fab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.754263:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703fab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.754272:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703fab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.754296:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813288.754483:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813288.754491:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703fab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.754500:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813288.754505:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703fab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.754515:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703fab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.754532:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703fab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.754546:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2168e2/0xf32533d6ff703fab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.754562:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.754564:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.754565:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813288.755026:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813288.755032:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec86a9bb/0xf32533d6ff703fb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.755041:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788813288.755045:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813288.755049:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec86a9bb/0xf32533d6ff703fb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.755060:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec86a9bb/0xf32533d6ff703fb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.755067:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec86a9bb/0xf32533d6ff703fb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.755086:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec86a9bb/0xf32533d6ff703fb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.755101:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813288.755110:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813288.755115:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec86a9bb/0xf32533d6ff703fb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.755123:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813288.755127:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec86a9bb/0xf32533d6ff703fb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.755135:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec86a9bb/0xf32533d6ff703fb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.755146:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec86a9bb/0xf32533d6ff703fb2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.755153:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec86a9bb/0xf32533d6ff703fb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.755164:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.755165:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.755167:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813288.755960:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813288.755976:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009db7a633/0xf32533d6ff703fb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.755986:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788813288.755989:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813288.755994:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009db7a633/0xf32533d6ff703fb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.756006:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009db7a633/0xf32533d6ff703fb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.756014:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009db7a633/0xf32533d6ff703fb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.756022:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009db7a633/0xf32533d6ff703fb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.756040:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813288.756183:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.756189:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009db7a633/0xf32533d6ff703fb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.756197:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.756201:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009db7a633/0xf32533d6ff703fb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.756209:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009db7a633/0xf32533d6ff703fb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.756221:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009db7a633/0xf32533d6ff703fb9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.756229:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009db7a633/0xf32533d6ff703fb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.756244:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.756246:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.756248:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813288.756319:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788813288.756325:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cf1ae32/0xf32533d6ff703fc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.756333:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788813288.756336:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813288.756340:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cf1ae32/0xf32533d6ff703fc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.756350:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cf1ae32/0xf32533d6ff703fc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.756364:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cf1ae32/0xf32533d6ff703fc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.756371:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cf1ae32/0xf32533d6ff703fc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.756394:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1788813288.756495:0:18665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1788813288.756534:0:18665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788813288.756550:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813288.756555:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cf1ae32/0xf32533d6ff703fc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.756563:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09e00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:1.0:1788813288.756566:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cf1ae32/0xf32533d6ff703fc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.756584:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cf1ae32/0xf32533d6ff703fc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.756594:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cf1ae32/0xf32533d6ff703fc0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.756600:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cf1ae32/0xf32533d6ff703fc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813288.756612:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.756614:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.756615:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813288.756912:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17187:x1875706313367936:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6433us (6517us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788813288.756928:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00002000:00010000:3.0:1788813288.759754:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788813288.759781:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703fc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.759798:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1788813288.759804:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813288.759893:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703fc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.759911:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703fc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.759923:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703fc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.759947:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703fc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813288.759974:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813288.760916:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813288.760925:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703fc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.760956:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813288.760961:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703fc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.760971:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703fc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.760987:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703fc7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.760994:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b659bee8/0xf32533d6ff703fc7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.761016:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.761024:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.761026:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813288.762128:0:17187:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788813288.762143:0:17187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46547100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17187:1875706313367936:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788813288.762162:0:17187:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00002000:00010000:0.0:1788813288.762332:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.762339:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff703fce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.762352:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.762356:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.762361:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff703fce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.762374:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff703fce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.762383:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff703fce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.762390:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff703fce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.762405:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813288.762912:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.762918:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f84624f/0xf32533d6ff703fd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.762927:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.762944:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813288.762949:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813288.762955:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f84624f/0xf32533d6ff703fd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.762956:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff703fce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.762965:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdae00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813288.762966:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f84624f/0xf32533d6ff703fd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.762969:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff703fce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.762974:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f84624f/0xf32533d6ff703fd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.762978:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff703fce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.762982:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f84624f/0xf32533d6ff703fd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.762993:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff703fce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.762995:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813288.763000:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0690f24/0xf32533d6ff703fce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.763014:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813288.763017:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f84624f/0xf32533d6ff703fd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.763023:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdaa00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813288.763026:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f84624f/0xf32533d6ff703fd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.763045:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f84624f/0xf32533d6ff703fd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.763056:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f84624f/0xf32533d6ff703fd5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.763065:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f84624f/0xf32533d6ff703fd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.763077:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.763080:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.763082:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813288.763347:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.763353:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703fdc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.763360:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.763363:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.763367:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703fdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.763376:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703fdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.763384:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703fdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.763401:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703fdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.763422:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813288.763622:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813288.763627:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703fdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.763636:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda000 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813288.763639:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703fdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.763647:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703fdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813288.763653:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.763657:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d5de17/0xf32533d6ff703fe3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.763658:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703fdc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.763666:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.763669:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.763673:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051d5de17/0xf32533d6ff703fe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.763677:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b1cece7/0xf32533d6ff703fdc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.763682:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051d5de17/0xf32533d6ff703fe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.763689:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.763689:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d5de17/0xf32533d6ff703fe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.763691:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.763693:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.763696:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051d5de17/0xf32533d6ff703fe3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.764129:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813288.764860:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.764867:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff703fea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.764885:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.764889:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.764894:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff703fea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.764906:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff703fea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.764916:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff703fea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.764923:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff703fea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.771183:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788813288.771198:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051d5de17/0xf32533d6ff703fe3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.771213:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813288.771218:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d5de17/0xf32533d6ff703fe3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.771230:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d5de17/0xf32533d6ff703fe3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.771253:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051d5de17/0xf32533d6ff703fe3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.771261:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051d5de17/0xf32533d6ff703fe3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.771281:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813288.771285:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff703fea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.771302:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda200 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813288.771305:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff703fea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.771313:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff703fea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.771324:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff703fea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.771331:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.771333:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.771335:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813288.778385:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788813288.778400:0:18668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abc12f4b/0xf32533d6ff703fea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813288.779057:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.779065:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ff1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.779080:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.779084:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.779091:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ff1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.779116:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ff1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.779127:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ff1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.779135:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ff1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.779231:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813288.779483:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788813288.779489:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ff8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.779498:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788813288.779501:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813288.779505:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ff8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.779515:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ff8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.779524:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ff8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.779542:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ff8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813288.779551:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1788813288.779578:0:18668:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1788813288.779677:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17189:x1875706313367168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 155013us (155242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813288.779688:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788813288.780803:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788813288.780815:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ff1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.780826:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdac00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813288.780831:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ff1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.780842:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ff1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.780861:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ff1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.780875:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4510369/0xf32533d6ff703ff1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.780896:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813288.780900:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ff8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.780906:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdbc00 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813288.780909:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ff8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.780917:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ff8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.780927:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ff8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.780954:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003109aa10/0xf32533d6ff703ff8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813288.780967:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.780968:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813288.780970:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813288.781128:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813288.783696:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813288.783779:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17189:1875706313367168:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788813288.783802:0:17189:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1788813288.783866:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17189:1875706313368064:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788813288.783959:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813288.783991:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489434acc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813288.791124:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313368064 00000100:00100000:1.0:1788813288.791140:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313368064 00000100:00100000:0.0:1788813288.794084:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788813288.794103:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17189:x1875706313368064:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788813288.794152:0:19582:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:1.0:1788813288.799121:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17189:x1875706313368064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5018us (15184us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788813288.799140:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788813288.799783:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17189:1875706313368064:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788813288.799799:0:17189:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:2.0:1788813288.870083:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813289.892169:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813290.852706:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313368192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813290.852798:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813290.852987:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313368192 00000100:00100000:0.0:1788813290.852996:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313368192 00000100:00100000:0.0:1788813290.853057:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813290.853068:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313368192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788813290.853098:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1788813290.855715:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813290.858685:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313368192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5606us (5874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813290.859906:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313368192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788813290.862121:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788813290.916299:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813291.877864:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313368320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788813291.877963:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813291.878043:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313368320 00000100:00100000:2.0:1788813291.878052:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313368320 00000100:00100000:2.0:1788813291.878102:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788813291.878111:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313368320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788813291.878150:0:17902:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788813291.878229:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313368320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813291.878236:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788813291.878287:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313368320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813291.879130:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813291.879143:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313368448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813291.879185:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813291.881328:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313368448 00000100:00100000:0.0:1788813291.881347:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313368448 00000100:00100000:0.0:1788813291.881432:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813291.881454:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313368448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813291.881514:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788813291.881599:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313368448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (2412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813291.881606:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813291.881662:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313368448:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788813291.942459:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788813292.914070:0:19841:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788813292.966033:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788813293.911328:0:19893:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788813293.911579:0:19893:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788813293.928036:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313368576:0@lo:400:kworker.0 00000100:00100000:2.0:1788813293.928105:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813293.930324:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313369088:0@lo:400:kworker.0 00000100:00100000:2.0:1788813293.930381:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813293.930402:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313369600:0@lo:400:kworker.0 00000100:00100000:3.0:1788813293.930997:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313368832:0@lo:400:kworker.0 00000100:00100000:0.0:1788813293.933018:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313369088 00000100:00100000:0.0:1788813293.933029:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313369088 00000100:00100000:0.0:1788813293.933088:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788813293.933097:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313369088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813293.933520:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813293.933564:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313369344:0@lo:400:kworker.0 00000100:00100000:3.0:1788813293.933588:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813293.933607:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313369856:0@lo:400:kworker.0 00000100:00100000:3.0:1788813293.933629:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813293.933652:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313370368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813293.933728:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813293.933956:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313368832 00000100:00100000:1.0:1788813293.933977:0:18671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313368832 00000100:00100000:1.0:1788813293.934016:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313369344 00000100:00100000:1.0:1788813293.934019:0:18671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313369344 00000100:00100000:1.0:1788813293.934038:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813293.934045:0:18671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313368832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813293.934110:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788813293.934128:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313368704:0@lo:400:kworker.0 00000100:00100000:1.0:1788813293.936016:0:18671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313368832:12345-0@lo:400:kworker.0 Request processed in 1962us (2488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813293.936249:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813293.936298:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313370112:0@lo:400:kworker.0 00000100:00100000:2.0:1788813293.936324:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813293.936342:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788813293.936347:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313368960:0@lo:400:kworker.0 00000100:00100000:2.0:1788813293.936365:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813293.936379:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313369472:0@lo:400:kworker.0 00000100:00100000:2.0:1788813293.936433:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813293.936444:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313369984:0@lo:400:kworker.0 00000100:00100000:2.0:1788813293.936463:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813293.936470:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313370496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813293.936486:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813293.936523:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313368960 00000100:00100000:2.0:1788813293.936529:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313368960 00000100:00100000:2.0:1788813293.936562:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313369472 00000100:00100000:2.0:1788813293.936564:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313369472 00000100:00100000:2.0:1788813293.936578:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788813293.936585:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313369344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813293.936623:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313369344:12345-0@lo:400:kworker.0 Request processed in 39us (3034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813293.936629:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788813293.936643:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813293.936648:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71412d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313368960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813293.936672:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71412d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313368960:12345-0@lo:400:kworker.0 Request processed in 24us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813293.936689:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813293.936700:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813293.936722:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313369472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813293.936909:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313369472:12345-0@lo:400:kworker.0 Request processed in 197us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813293.936916:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813293.936961:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313370368 00000100:00100000:2.0:1788813293.936964:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313370368 00000100:00100000:2.0:1788813293.936981:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313370496 00000100:00100000:2.0:1788813293.936983:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313370496 00000100:00100000:2.0:1788813293.936991:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813293.936996:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1875706313370368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813293.937017:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788813293.937051:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1875706313370368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (3323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813293.937057:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813293.937067:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813293.937071:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313370496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813293.937096:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788813293.937193:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1875706313370496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813293.937200:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813293.937564:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313368960:0@lo:400:kworker.0 00000100:00100000:2.0:1788813293.937574:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313369472:0@lo:400:kworker.0 00000100:00100000:2.0:1788813293.937587:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313370496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813293.938945:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788813293.938992:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813293.938996:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813293.939036:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313369856 00000100:00100000:1.0:1788813293.939045:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313369856 00000100:00100000:1.0:1788813293.939096:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313369600 00000100:00100000:1.0:1788813293.939099:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313369600 00000100:00100000:1.0:1788813293.939110:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313370112 00000100:00100000:1.0:1788813293.939122:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313370112 00000100:00100000:1.0:1788813293.939141:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313369984 00000100:00100000:1.0:1788813293.939144:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313369984 00000100:00100000:1.0:1788813293.939160:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788813293.939168:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313369856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813293.939241:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313369856:12345-0@lo:400:kworker.0 Request processed in 75us (5612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813293.939247:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788813293.939260:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813293.939265:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313369600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813293.939312:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313369600:12345-0@lo:400:kworker.0 Request processed in 47us (3064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813293.939318:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813293.939333:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788813293.939338:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313370112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813293.939378:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313370112:12345-0@lo:400:kworker.0 Request processed in 39us (3052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813293.939383:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788813293.939398:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788813293.939404:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313369984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813293.939427:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875706313369984:12345-0@lo:400:kworker.0 Request processed in 24us (2963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813293.939432:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788813293.939889:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813293.939925:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313369216:0@lo:400:kworker.0 00000100:00100000:3.0:1788813293.939979:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813293.940003:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a764c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313369728:0@lo:400:kworker.0 00000100:00100000:3.0:1788813293.940070:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813293.940090:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313370240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813293.940187:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813293.940232:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313370368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813293.940243:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313368832:0@lo:400:kworker.0 00000100:00100000:3.0:1788813293.940252:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313369344:0@lo:400:kworker.0 00010000:00080000:3.0:1788813293.940264:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a71410a80 x1875706313369856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813293.940288:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313369856:0@lo:400:kworker.0 00000100:00100000:3.0:1788813293.940420:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313369728 00000100:00100000:3.0:1788813293.940426:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313369728 00000100:00100000:3.0:1788813293.940455:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788813293.940462:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313369728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813293.940502:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875706313369728:12345-0@lo:400:kworker.0 Request processed in 40us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813293.940508:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788813293.940534:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313368704 00000100:00100000:3.0:1788813293.940537:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313368704 00000100:00100000:3.0:1788813293.940557:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313369216 00000100:00100000:3.0:1788813293.940560:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313369216 00000100:00100000:3.0:1788813293.940573:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813293.940578:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313368704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813293.940608:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313368704:12345-0@lo:400:kworker.0 Request processed in 30us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813293.940613:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813293.940624:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788813293.940632:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313369216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813293.940658:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313369216:12345-0@lo:400:kworker.0 Request processed in 28us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813293.940663:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788813293.940687:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313368704:0@lo:400:kworker.0 00000100:00100000:3.0:1788813293.940697:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313369216:0@lo:400:kworker.0 00010000:00080000:3.0:1788813293.941329:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a764c9500 x1875706313369728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813293.941341:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1875706313369728:0@lo:400:kworker.0 00000100:00100000:1.0:1788813293.942019:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313368576 00000100:00100000:1.0:1788813293.942093:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313368576 00000100:00100000:1.0:1788813293.942211:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788813293.942221:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+24:3628:x1875706313368576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813293.942286:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+24:3628:x1875706313368576:12345-0@lo:400:kworker.0 Request processed in 67us (14181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813293.942293:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788813293.942450:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313369088:12345-0@lo:400:kworker.0 Request processed in 9352us (12066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813293.942459:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788813293.945470:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813293.945480:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788813293.945515:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313370240 00000100:00100000:2.0:1788813293.945525:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313370240 00000100:00100000:2.0:1788813293.945582:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813293.945593:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313370240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813293.945617:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788813293.945705:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313370240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (5589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813293.945732:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813293.945959:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313370240:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788813293.946010:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a71410e00 x1875706313369984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813293.946022:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1875706313369984:0@lo:400:kworker.0 00000100:00100000:2.0:1788813293.946033:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313368576:0@lo:400:kworker.0 00010000:00080000:2.0:1788813293.946044:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a76405180 x1875706313369088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813293.946051:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313369088:0@lo:400:kworker.0 00010000:00080000:2.0:1788813293.946063:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a764c8380 x1875706313369600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813293.946071:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a764c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313369600:0@lo:400:kworker.0 00010000:00080000:2.0:1788813293.946082:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a71411c00 x1875706313370112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813293.946090:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313370112:0@lo:400:kworker.0 00010000:00010000:2.0:1788813293.992703:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788813294.884353:0:19944:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788813294.885868:0:19944:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:2.0:1788813294.958618:0:19483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:2.0:1788813295.012048:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813295.173616:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813295.173736:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301763712 00000100:00100000:0.0:1788813295.173747:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301763712 00000100:00100000:0.0:1788813295.173863:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 115 00000100:00100000:0.0:1788813295.173872:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2395:x1875706301763712:12345-192.168.202.13@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788813295.173901:0:17156:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 8d3a369b-b89e-4ca2-be4d-9afac76fe88b@192.168.202.13@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:0.0:1788813295.173974:0:17156:0:(genops.c:1384:class_connect()) connect: client 8d3a369b-b89e-4ca2-be4d-9afac76fe88b, cookie 0xf32533d6ff703fff 00000100:00080000:0.0:1788813295.174125:0:17156:0:(import.c:65:import_set_state_nolock()) ffff948a44e12800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813295.174226:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+5:2395:x1875706301763712:12345-192.168.202.13@tcp:250:mount.lustre.0 Request processed in 323us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813295.174234:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 115 00000100:00100000:3.0:1788813295.183588:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813295.185556:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301763840 00000100:00100000:1.0:1788813295.185573:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301763840 00000100:00100000:1.0:1788813295.185632:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 116 00000100:00100000:1.0:1788813295.185643:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+5:14870:x1875706301763840:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788813295.185661:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813295.185688:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8400/0xf32533d6ff704006 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a86 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813295.185729:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8400/0xf32533d6ff704006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a86 expref: 6 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813295.185741:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8400/0xf32533d6ff704006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a86 expref: 6 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813295.185750:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8400, rc 0) 00000100:00100000:1.0:1788813295.185848:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+6:14870:x1875706301763840:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 207us (2269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813295.185856:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 116 00000100:00100000:2.0:1788813295.188432:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813295.188523:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301763968 00000100:00100000:1.0:1788813295.188530:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301763968 00000100:00100000:1.0:1788813295.188624:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 117 00000100:00100000:1.0:1788813295.188634:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+6:14870:x1875706301763968:12345-192.168.202.13@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788813295.188753:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+6:14870:x1875706301763968:12345-192.168.202.13@tcp:501:mount.lustre.0 Request processed in 122us (331us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813295.188758:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 117 00000100:00100000:2.0:1788813295.191630:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813295.191878:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301764096 00000100:00100000:0.0:1788813295.191887:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301764096 00000100:00100000:0.0:1788813295.192368:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 118 00000100:00100000:0.0:1788813295.192380:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+6:14870:x1875706301764096:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788813295.192407:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813295.192426:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cda200/0xf32533d6ff70400d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729a8d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813295.192456:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cda200/0xf32533d6ff70400d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a8d expref: 7 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813295.192469:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cda200/0xf32533d6ff70400d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729a8d expref: 7 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813295.192478:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cda200, rc 0) 00000100:00100000:0.0:1788813295.192544:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+7:14870:x1875706301764096:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 166us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813295.192551:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 118 00000100:00100000:2.0:1788813295.195164:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813295.195281:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301764224 00000100:00100000:1.0:1788813295.195293:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301764224 00000100:00100000:1.0:1788813295.195387:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 119 00000100:00100000:1.0:1788813295.195409:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+7:14870:x1875706301764224:12345-192.168.202.13@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788813295.195580:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+8:14870:x1875706301764224:12345-192.168.202.13@tcp:501:mount.lustre.0 Request processed in 182us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813295.195588:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 119 00000100:00100000:2.0:1788813295.197497:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813295.197623:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301764352 00000100:00100000:0.0:1788813295.197633:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301764352 00000100:00100000:0.0:1788813295.197694:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 120 00000100:00100000:0.0:1788813295.197714:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+8:14870:x1875706301764352:12345-192.168.202.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788813295.198006:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+8:14870:x1875706301764352:12345-192.168.202.13@tcp:503:mount.lustre.0 Request processed in 302us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813295.198015:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 120 00000100:00100000:2.0:1788813295.203608:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813295.204359:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301764480 00000100:00100000:0.0:1788813295.204371:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301764480 00000100:00100000:2.0:1788813295.205018:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 121 00000100:00100000:2.0:1788813295.205029:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+8:14889:x1875706301764480:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813295.205184:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+8:14889:x1875706301764480:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 157us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813295.205192:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 121 00000100:00100000:2.0:1788813295.226494:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813295.232614:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301764608 00000100:00100000:1.0:1788813295.232631:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301764608 00000100:00100000:2.0:1788813295.234972:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 122 00000100:00100000:2.0:1788813295.234989:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+8:14889:x1875706301764608:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813295.235203:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+8:14889:x1875706301764608:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 217us (8719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813295.235211:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 122 00000100:00100000:1.0:1788813295.260251:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813295.260856:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301764736 00000100:00100000:3.0:1788813295.260867:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301764736 00000100:00100000:3.0:1788813295.260926:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 123 00000100:00100000:3.0:1788813295.260956:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+8:14889:x1875706301764736:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788813295.261140:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+8:14889:x1875706301764736:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 187us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813295.261149:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 123 00000100:00100000:3.0:1788813295.263928:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813295.264206:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301764864 00000100:00100000:2.0:1788813295.264215:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301764864 00000100:00100000:2.0:1788813295.264274:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 124 00000100:00100000:2.0:1788813295.264284:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+8:14870:x1875706301764864:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788813295.264301:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813295.264318:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc08600/0xf32533d6ff704014 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729abe expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813295.264361:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc08600/0xf32533d6ff704014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729abe expref: 9 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813295.264373:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc08600/0xf32533d6ff704014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729abe expref: 9 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813295.264381:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08600, rc 0) 00000100:00100000:2.0:1788813295.264512:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+9:14870:x1875706301764864:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 228us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813295.264519:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 124 00000100:00100000:2.0:1788813295.267809:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813295.268846:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301764992 00000100:00100000:0.0:1788813295.268859:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301764992 00000100:00100000:0.0:1788813295.268993:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 125 00000100:00100000:0.0:1788813295.269015:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+9:14870:x1875706301764992:12345-192.168.202.13@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788813295.269053:0:17156:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788813295.269078:0:17156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788813295.269082:0:17156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788813295.269086:0:17156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788813295.269088:0:17156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788813295.269090:0:17156:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788813295.272422:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+9:14870:x1875706301764992:12345-192.168.202.13@tcp:256:mount.lustre.0 Request processed in 3401us (4603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813295.272437:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 125 00000100:00100000:3.0:1788813295.277188:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813295.277458:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301765120 00000100:00100000:1.0:1788813295.277468:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301765120 00000100:00100000:1.0:1788813295.277531:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 126 00000100:00100000:1.0:1788813295.277541:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+9:14870:x1875706301765120:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788813295.277564:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813295.277582:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8e00/0xf32533d6ff70401b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729ac5 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813295.277609:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8e00/0xf32533d6ff70401b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ac5 expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813295.277620:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8e00/0xf32533d6ff70401b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ac5 expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813295.277629:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8e00, rc 0) 00000100:00100000:1.0:1788813295.277707:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+10:14870:x1875706301765120:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 159us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813295.277714:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 126 00000100:00100000:3.0:1788813295.280391:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813295.280589:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301765248 00000100:00100000:0.0:1788813295.280598:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301765248 00000100:00100000:0.0:1788813295.280654:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 127 00000100:00100000:0.0:1788813295.280673:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+10:14870:x1875706301765248:12345-192.168.202.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788813295.281295:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+10:14870:x1875706301765248:12345-192.168.202.13@tcp:501:mount.lustre.0 Request processed in 630us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813295.281305:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 127 00000100:00100000:3.0:1788813295.284533:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813295.284624:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301765376 00000100:00100000:2.0:1788813295.284634:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301765376 00000100:00100000:2.0:1788813295.284710:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 128 00000100:00100000:2.0:1788813295.284721:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943411c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+10:14870:x1875706301765376:12345-192.168.202.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788813295.285532:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943411c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+10:14870:x1875706301765376:12345-192.168.202.13@tcp:503:mount.lustre.0 Request processed in 808us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813295.285551:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 128 00000100:00100000:3.0:1788813295.289192:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813295.290096:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301765504 00000100:00100000:1.0:1788813295.290110:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301765504 00000100:00100000:1.0:1788813295.290183:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 129 00000100:00100000:1.0:1788813295.290194:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943411050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+10:14894:x1875706301765504:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813295.290345:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943411050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+10:14894:x1875706301765504:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 153us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813295.290353:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 129 00000100:00100000:1.0:1788813295.300720:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813295.300899:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301765632 00000100:00100000:2.0:1788813295.300911:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301765632 00000100:00100000:2.0:1788813295.301006:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 130 00000100:00100000:2.0:1788813295.301017:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+10:14894:x1875706301765632:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813295.301188:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+10:14894:x1875706301765632:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 172us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813295.301197:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 130 00000100:00100000:0.0:1788813295.333287:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813295.333334:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813295.333651:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301765760 00000100:00100000:3.0:1788813295.333672:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301765760 00000100:00100000:0.0:1788813295.333885:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:0.0:1788813295.333894:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1875706301765760:12345-192.168.202.13@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788813295.333926:0:17161:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 39adb0c8-c140-4b12-b8dc-f0861ff799f7@192.168.202.13@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:0.0:1788813295.334014:0:17161:0:(genops.c:1384:class_connect()) connect: client 39adb0c8-c140-4b12-b8dc-f0861ff799f7, cookie 0xf32533d6ff704022 00000004:00100000:0.0:1788813295.334054:0:17161:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788813295.334263:0:17161:0:(import.c:65:import_set_state_nolock()) ffff948a7b57c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813295.334330:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2395:x1875706301765760:12345-192.168.202.13@tcp:38:mount.lustre.0 Request processed in 436us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813295.334338:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:3.0:1788813295.334423:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301766016 00000100:00100000:3.0:1788813295.334428:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301766016 00000100:00100000:3.0:1788813295.334457:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:3.0:1788813295.334462:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1875706301766016:12345-192.168.202.13@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788813295.334478:0:17164:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 39adb0c8-c140-4b12-b8dc-f0861ff799f7@192.168.202.13@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:3.0:1788813295.334508:0:17164:0:(genops.c:1384:class_connect()) connect: client 39adb0c8-c140-4b12-b8dc-f0861ff799f7, cookie 0xf32533d6ff704029 00000004:00100000:3.0:1788813295.334528:0:17164:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788813295.335037:0:17164:0:(import.c:65:import_set_state_nolock()) ffff948a6e6de800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813295.335074:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2395:x1875706301766016:12345-192.168.202.13@tcp:38:mount.lustre.0 Request processed in 610us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813295.335082:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:2.0:1788813295.358166:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813295.358237:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813295.358355:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301765888 00000100:00100000:1.0:1788813295.358365:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301765888 00000100:00100000:1.0:1788813295.358448:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301766272 00000100:00100000:1.0:1788813295.358453:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301766272 00000100:00100000:1.0:1788813295.358483:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:1.0:1788813295.358494:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:0:x1875706301765888:12345-192.168.202.13@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788813295.358533:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788813295.358640:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:0:x1875706301765888:12345-192.168.202.13@tcp:41:mount.lustre.0 Request processed in 147us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813295.358647:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:1.0:1788813295.358671:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:1.0:1788813295.358678:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:14870:x1875706301766272:12345-192.168.202.13@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788813295.358689:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788813295.358722:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:14870:x1875706301766272:12345-192.168.202.13@tcp:41:mount.lustre.0 Request processed in 45us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813295.358739:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00080000:2.0:1788813295.358966:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813295.367180:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813295.367272:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813295.367364:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301766144 00000100:00100000:3.0:1788813295.367374:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301766144 00000100:00100000:3.0:1788813295.367450:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301766400 00000100:00100000:3.0:1788813295.367454:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301766400 00000100:00100000:3.0:1788813295.367478:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:3.0:1788813295.367487:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:0:x1875706301766144:12345-192.168.202.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788813295.367525:0:18693:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788813295.367607:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:0:x1875706301766144:12345-192.168.202.13@tcp:41:mount.lustre.0 Request processed in 120us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813295.367614:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:3.0:1788813295.367632:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12 00000100:00100000:3.0:1788813295.367639:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:14870:x1875706301766400:12345-192.168.202.13@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788813295.367675:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:14870:x1875706301766400:12345-192.168.202.13@tcp:40:mount.lustre.0 Request processed in 37us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813295.367682:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12 00000100:00080000:2.0:1788813295.369309:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813295.376065:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813295.376169:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301766784 00000100:00100000:1.0:1788813295.376180:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301766784 00000100:00100000:1.0:1788813295.376237:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:1.0:1788813295.376248:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:14870:x1875706301766784:12345-192.168.202.13@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788813295.376339:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:14870:x1875706301766784:12345-192.168.202.13@tcp:900:mount.lustre.0 Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813295.376346:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:3.0:1788813295.379791:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813295.379851:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813295.379975:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301766528 00000100:00100000:2.0:1788813295.379985:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301766528 00000100:00100000:2.0:1788813295.380019:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301766656 00000100:00100000:2.0:1788813295.380022:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301766656 00000100:00100000:2.0:1788813295.380060:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:2.0:1788813295.380068:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1875706301766528:12345-192.168.202.13@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788813295.380105:0:18670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 39adb0c8-c140-4b12-b8dc-f0861ff799f7@192.168.202.13@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:2.0:1788813295.380136:0:18670:0:(genops.c:1384:class_connect()) connect: client 39adb0c8-c140-4b12-b8dc-f0861ff799f7, cookie 0xf32533d6ff704030 00002000:00100000:2.0:1788813295.380148:0:18670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 39adb0c8-c140-4b12-b8dc-f0861ff799f7/ffff948942c68000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788813295.380168:0:18670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788813295.380347:0:18670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788813295.380381:0:18670:0:(import.c:65:import_set_state_nolock()) ffff948942c6d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813295.380517:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:0.0:1788813295.380524:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ccf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1875706301766656:12345-192.168.202.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788813295.380542:0:18668:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 39adb0c8-c140-4b12-b8dc-f0861ff799f7@192.168.202.13@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:0.0:1788813295.380564:0:18668:0:(genops.c:1384:class_connect()) connect: client 39adb0c8-c140-4b12-b8dc-f0861ff799f7, cookie 0xf32533d6ff704037 00002000:00100000:0.0:1788813295.380570:0:18668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 39adb0c8-c140-4b12-b8dc-f0861ff799f7/ffff948a7b57f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788813295.380581:0:18668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788813295.380720:0:18668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788813295.380736:0:18668:0:(import.c:65:import_set_state_nolock()) ffff948a7b56a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813295.380799:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2395:x1875706301766656:12345-192.168.202.13@tcp:8:mount.lustre.0 Request processed in 272us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813295.380806:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:0.0:1788813295.382347:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ccfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2395:x1875706301766528:12345-192.168.202.13@tcp:8:mount.lustre.0 Request processed in 2268us (2556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813295.382360:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:3.0:1788813295.391836:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813295.392092:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301766912 00000100:00100000:2.0:1788813295.392103:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301766912 00000100:00100000:2.0:1788813295.392163:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:2.0:1788813295.392173:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:14870:x1875706301766912:12345-192.168.202.13@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788813295.395979:0:17165:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3718us 00000040:00080000:0.0:1788813295.396763:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000004:00200000:2.0:1788813295.411803:0:17165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788813295.411965:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:14870:x1875706301766912:12345-192.168.202.13@tcp:33:mount.lustre.0 Request processed in 19787us (20130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813295.411975:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:3.0:1788813295.608610:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813295.608840:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301767040 00000100:00100000:1.0:1788813295.608851:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301767040 00000100:00100000:3.0:1788813295.609049:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:3.0:1788813295.609068:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:14917:x1875706301767040:12345-192.168.202.13@tcp:101:mkdir.0 00010000:00010000:3.0:1788813295.609103:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813295.609134:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff70403e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729af6 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813295.609207:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704045 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813295.609221:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704045 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813295.609237:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704045 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813295.609290:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788813295.609295:0:17164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813295.609332:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704045 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813295.609359:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657800/0xf32533d6ff70403e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729af6 expref: 8 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813295.609377:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704045 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729af6 expref: 7 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813295.609386:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe40a00) 00010000:00010000:3.0:1788813295.609389:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813295.609392:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657c00, rc 0) 00000100:00100000:3.0:1788813295.609459:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:14917:x1875706301767040:12345-192.168.202.13@tcp:101:mkdir.0 Request processed in 395us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813295.609475:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:2.0:1788813295.972276:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313370624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813295.972376:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813295.972663:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313370624 00000100:00100000:0.0:1788813295.972673:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313370624 00000100:00080000:2.0:1788813295.972799:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813295.974567:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788813295.974590:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313370624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788813295.974634:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788813295.974730:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313370624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (2353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813295.974737:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788813295.974868:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313370624:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788813296.036150:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813296.996234:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813296.996258:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313370752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813296.996333:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813296.996896:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313370752 00000100:00100000:2.0:1788813296.996908:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313370752 00000100:00100000:2.0:1788813296.996995:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788813296.997006:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313370752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788813296.997042:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788813296.997095:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313370752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813296.997102:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788813296.997371:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313370752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813296.998750:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813296.998769:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a71412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313370880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813296.998826:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813296.999637:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313370880 00000100:00100000:2.0:1788813296.999647:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313370880 00000100:00100000:2.0:1788813296.999721:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788813296.999731:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313370880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788813296.999765:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788813296.999829:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313370880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813296.999836:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788813296.999994:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a71412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313370880:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788813297.061756:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813297.831260:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000040:00080000:0.0:1788813297.831830:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788813297.832663:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301767168 00000100:00100000:1.0:1788813297.832685:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301767168 00000100:00100000:1.0:1788813297.832773:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00100000:1.0:1788813297.832785:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:14969:x1875706301767168:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:1.0:1788813297.832816:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788813297.832917:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:14969:x1875706301767168:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 134us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813297.832925:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00080000:2.0:1788813297.836422:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813297.840870:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813297.841046:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301767296 00000100:00100000:3.0:1788813297.841056:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301767296 00000100:00100000:3.0:1788813297.841132:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:3.0:1788813297.841143:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:14969:x1875706301767296:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:3.0:1788813297.841177:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788813297.841279:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:14969:x1875706301767296:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 138us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813297.841287:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00080000:2.0:1788813297.841612:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788813297.844966:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813297.845529:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301767424 00000100:00100000:1.0:1788813297.845539:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301767424 00000100:00100000:1.0:1788813297.845624:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:1.0:1788813297.845637:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:14969:x1875706301767424:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:1.0:1788813297.845670:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788813297.845778:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:14969:x1875706301767424:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 144us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813297.845785:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00080000:2.0:1788813297.846004:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813297.848560:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813297.848763:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301767552 00000100:00100000:1.0:1788813297.848773:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301767552 00000100:00100000:1.0:1788813297.848847:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:1.0:1788813297.848859:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:14969:x1875706301767552:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:1.0:1788813297.848909:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788813297.849044:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:14969:x1875706301767552:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 188us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813297.849051:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00080000:2.0:1788813297.849130:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813298.073296:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813298.073738:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301767680 00000100:00100000:2.0:1788813298.073765:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301767680 00000100:00100000:2.0:1788813298.073845:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 131 00000100:00100000:2.0:1788813298.073857:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943410850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+10:15003:x1875706301767680:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788813298.073874:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813298.073893:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc09400/0xf32533d6ff70404c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729afd expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813298.073920:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc09400/0xf32533d6ff70404c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729afd expref: 11 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813298.073965:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc09400/0xf32533d6ff70404c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729afd expref: 11 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813298.073974:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09400, rc 0) 00000100:00100000:2.0:1788813298.074160:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943410850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:15003:x1875706301767680:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 305us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813298.074168:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 131 00000100:00100000:3.0:1788813298.082704:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813298.082833:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301767808 00000100:00100000:1.0:1788813298.082845:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301767808 00000100:00100000:1.0:1788813298.082907:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 132 00000100:00100000:1.0:1788813298.082916:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:15003:x1875706301767808:12345-192.168.202.13@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788813298.083113:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:15003:x1875706301767808:12345-192.168.202.13@tcp:501:mount.lustre.0 Request processed in 197us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813298.083121:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 132 00010000:00010000:2.0:1788813298.084612:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813298.087079:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813298.088211:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301767936 00000100:00100000:2.0:1788813298.088223:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301767936 00000100:00100000:2.0:1788813298.088289:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 133 00000100:00100000:2.0:1788813298.088300:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:15003:x1875706301767936:12345-192.168.202.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788813298.088652:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:15003:x1875706301767936:12345-192.168.202.13@tcp:503:mount.lustre.0 Request processed in 352us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813298.088660:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 133 00000100:00100000:3.0:1788813298.092616:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813298.092728:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301768064 00000100:00100000:1.0:1788813298.092738:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301768064 00000100:00100000:1.0:1788813298.092804:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 134 00000100:00100000:1.0:1788813298.092823:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:15008:x1875706301768064:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813298.093419:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:15008:x1875706301768064:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 604us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813298.093428:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 134 00000100:00100000:3.0:1788813298.113802:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813298.117875:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301768192 00000100:00100000:2.0:1788813298.117894:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301768192 00000100:00100000:2.0:1788813298.117990:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 135 00000100:00100000:2.0:1788813298.118018:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:15008:x1875706301768192:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813298.118191:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:15008:x1875706301768192:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 175us (4398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813298.118199:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 135 00000100:00100000:2.0:1788813298.123917:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813298.126376:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301768320 00000100:00100000:1.0:1788813298.126393:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301768320 00000100:00100000:1.0:1788813298.126468:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 136 00000100:00100000:1.0:1788813298.126479:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:15008:x1875706301768320:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813298.126648:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:15008:x1875706301768320:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 170us (2741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813298.126666:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 136 00000100:00100000:1.0:1788813298.131746:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813298.131840:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301768448 00000100:00100000:0.0:1788813298.131851:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301768448 00000100:00100000:0.0:1788813298.131905:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 137 00000100:00100000:0.0:1788813298.131915:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:15003:x1875706301768448:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788813298.131955:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813298.131972:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cdae00/0xf32533d6ff704053 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729b2e expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813298.132000:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdae00/0xf32533d6ff704053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b2e expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813298.132011:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cdae00/0xf32533d6ff704053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b2e expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813298.132020:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdae00, rc 0) 00000100:00100000:0.0:1788813298.132137:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+12:15003:x1875706301768448:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 222us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813298.132161:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 137 00000100:00100000:3.0:1788813298.135211:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813298.135367:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301768576 00000100:00100000:2.0:1788813298.135379:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301768576 00000100:00100000:2.0:1788813298.135435:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 138 00000100:00100000:2.0:1788813298.135445:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+12:15003:x1875706301768576:12345-192.168.202.13@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788813298.135470:0:17156:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788813298.135494:0:17156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788813298.135499:0:17156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788813298.135502:0:17156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788813298.135506:0:17156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788813298.135508:0:17156:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788813298.138623:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+12:15003:x1875706301768576:12345-192.168.202.13@tcp:256:mount.lustre.0 Request processed in 3170us (3411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813298.138637:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 138 00000100:00100000:1.0:1788813298.141024:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813298.141188:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301768704 00000100:00100000:2.0:1788813298.141196:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301768704 00000100:00100000:2.0:1788813298.141275:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 139 00000100:00100000:2.0:1788813298.141282:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+12:15003:x1875706301768704:12345-192.168.202.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788813298.141296:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813298.141310:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff70405a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729b35 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813298.141331:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff70405a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b35 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813298.141338:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff70405a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b35 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813298.141356:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08c00, rc 0) 00000100:00100000:2.0:1788813298.141412:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:15003:x1875706301768704:12345-192.168.202.13@tcp:101:mount.lustre.0 Request processed in 129us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813298.141419:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 139 00000100:00100000:3.0:1788813298.142905:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813298.142960:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301768832 00000100:00100000:0.0:1788813298.142968:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301768832 00000100:00100000:0.0:1788813298.143067:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 140 00000100:00100000:0.0:1788813298.143075:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:15003:x1875706301768832:12345-192.168.202.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788813298.143304:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:15003:x1875706301768832:12345-192.168.202.13@tcp:501:mount.lustre.0 Request processed in 230us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813298.143310:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 140 00000100:00100000:3.0:1788813298.144556:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813298.144612:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301768960 00000100:00100000:2.0:1788813298.144617:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301768960 00000100:00100000:2.0:1788813298.144712:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 141 00000100:00100000:2.0:1788813298.144719:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:15003:x1875706301768960:12345-192.168.202.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788813298.144811:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:15003:x1875706301768960:12345-192.168.202.13@tcp:503:mount.lustre.0 Request processed in 91us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813298.144818:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 141 00000100:00100000:2.0:1788813298.149524:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813298.149635:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301769088 00000100:00100000:0.0:1788813298.149648:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301769088 00000100:00100000:0.0:1788813298.149767:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 142 00000100:00100000:0.0:1788813298.149778:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:15013:x1875706301769088:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813298.149960:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:15013:x1875706301769088:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 157us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813298.149968:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 142 00000100:00100000:3.0:1788813298.152779:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813298.153056:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301769216 00000100:00100000:2.0:1788813298.153070:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301769216 00000100:00100000:2.0:1788813298.153197:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 143 00000100:00100000:2.0:1788813298.153208:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:15013:x1875706301769216:12345-192.168.202.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813298.153361:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:15013:x1875706301769216:12345-192.168.202.13@tcp:502:llog_process_th.0 Request processed in 156us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813298.153370:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 143 00000100:00100000:3.0:1788813298.166770:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813298.166859:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813298.167132:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301769344 00000100:00100000:0.0:1788813298.167142:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301769344 00000100:00100000:0.0:1788813298.167187:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301769600 00000100:00100000:0.0:1788813298.167191:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301769600 00000100:00100000:0.0:1788813298.167227:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:0.0:1788813298.167235:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1875706301769344:12345-192.168.202.13@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788813298.167264:0:17163:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 342c3357-8551-4188-a7af-8af88d224192@192.168.202.13@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:0.0:1788813298.167319:0:17163:0:(genops.c:1384:class_connect()) connect: client 342c3357-8551-4188-a7af-8af88d224192, cookie 0xf32533d6ff704061 00000004:00100000:0.0:1788813298.167343:0:17163:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788813298.167433:0:17163:0:(import.c:65:import_set_state_nolock()) ffff948a443b4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813298.167495:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342c3357-8551-4188-a7af-8af88d224192+6:2395:x1875706301769344:12345-192.168.202.13@tcp:38:mount.lustre.0 Request processed in 259us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813298.167502:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:0.0:1788813298.167521:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:0.0:1788813298.167525:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1875706301769600:12345-192.168.202.13@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788813298.167540:0:17163:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 342c3357-8551-4188-a7af-8af88d224192@192.168.202.13@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:0.0:1788813298.167562:0:17163:0:(genops.c:1384:class_connect()) connect: client 342c3357-8551-4188-a7af-8af88d224192, cookie 0xf32533d6ff704068 00000004:00100000:0.0:1788813298.167573:0:17163:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788813298.167616:0:17163:0:(import.c:65:import_set_state_nolock()) ffff948a443b6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813298.167652:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342c3357-8551-4188-a7af-8af88d224192+6:2395:x1875706301769600:12345-192.168.202.13@tcp:38:mount.lustre.0 Request processed in 125us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813298.167659:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:3.0:1788813298.171897:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813298.171988:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813298.172016:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813298.172042:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301770368 00000100:00100000:1.0:1788813298.172053:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301770368 00000100:00100000:3.0:1788813298.172056:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813298.172075:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301770240 00000100:00100000:3.0:1788813298.172078:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301770240 00000100:00100000:0.0:1788813298.172162:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301770112 00000100:00100000:0.0:1788813298.172167:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301770112 00000100:00100000:1.0:1788813298.172181:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:1.0:1788813298.172192:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2398:x1875706301770368:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813298.172198:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301769984 00000100:00100000:0.0:1788813298.172200:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301769984 00000100:00100000:0.0:1788813298.172235:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 38 00000100:00100000:0.0:1788813298.172242:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2398:x1875706301770112:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813298.172263:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2398:x1875706301770368:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 73us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813298.172269:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2398:x1875706301770112:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 28us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813298.172271:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:0.0:1788813298.172274:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 38 00000100:00100000:1.0:1788813298.172288:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:0.0:1788813298.172289:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 39 00000100:00100000:0.0:1788813298.172294:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:2398:x1875706301769984:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813298.172295:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2398:x1875706301770240:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813298.172316:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2398:x1875706301770240:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 23us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813298.172319:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:2398:x1875706301769984:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813298.172322:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:0.0:1788813298.172325:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 39 00000100:00100000:3.0:1788813298.179107:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813298.179185:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813298.181604:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301769728 00000100:00100000:2.0:1788813298.181618:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301769728 00000100:00100000:2.0:1788813298.181916:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301769472 00000100:00100000:2.0:1788813298.181920:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301769472 00000100:00100000:3.0:1788813298.181977:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:3.0:1788813298.181989:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342c3357-8551-4188-a7af-8af88d224192+6:0:x1875706301769728:12345-192.168.202.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788813298.182041:0:17161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788813298.182115:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342c3357-8551-4188-a7af-8af88d224192+6:0:x1875706301769728:12345-192.168.202.13@tcp:41:mount.lustre.0 Request processed in 128us (3018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813298.182123:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:3.0:1788813298.185178:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813298.185383:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301769856 00000100:00100000:0.0:1788813298.185393:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301769856 00000100:00100000:0.0:1788813298.185455:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00100000:0.0:1788813298.185465:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342c3357-8551-4188-a7af-8af88d224192+7:15003:x1875706301769856:12345-192.168.202.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788813298.185505:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788813298.185576:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342c3357-8551-4188-a7af-8af88d224192+7:15003:x1875706301769856:12345-192.168.202.13@tcp:41:mount.lustre.0 Request processed in 112us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813298.185583:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00080000:1.0:1788813298.186206:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813298.186212:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813298.187106:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813298.187267:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301770496 00000100:00100000:1.0:1788813298.187275:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301770496 00000100:00100000:1.0:1788813298.187323:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:1.0:1788813298.187333:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342c3357-8551-4188-a7af-8af88d224192+7:15003:x1875706301770496:12345-192.168.202.13@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788813298.187419:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342c3357-8551-4188-a7af-8af88d224192+7:15003:x1875706301770496:12345-192.168.202.13@tcp:40:mount.lustre.0 Request processed in 87us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813298.187425:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:2.0:1788813298.188042:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:2.0:1788813298.188052:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342c3357-8551-4188-a7af-8af88d224192+6:0:x1875706301769472:12345-192.168.202.13@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788813298.188076:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788813298.188119:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342c3357-8551-4188-a7af-8af88d224192+6:0:x1875706301769472:12345-192.168.202.13@tcp:41:mount.lustre.0 Request processed in 69us (8933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813298.188126:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:0.0:1788813298.193977:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813298.194006:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813298.194063:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813298.194135:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301770624 00000100:00100000:3.0:1788813298.194145:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301770624 00000100:00100000:3.0:1788813298.194190:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301770752 00000100:00100000:3.0:1788813298.194194:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301770752 00000100:00100000:3.0:1788813298.194217:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00100000:3.0:1788813298.194225:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1875706301770624:12345-192.168.202.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788813298.194256:0:18668:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 342c3357-8551-4188-a7af-8af88d224192@192.168.202.13@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:3.0:1788813298.194281:0:18668:0:(genops.c:1384:class_connect()) connect: client 342c3357-8551-4188-a7af-8af88d224192, cookie 0xf32533d6ff70406f 00002000:00100000:3.0:1788813298.194291:0:18668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 342c3357-8551-4188-a7af-8af88d224192/ffff948a6e6dc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788813298.194300:0:18668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788813298.194351:0:18668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788813298.194375:0:18668:0:(import.c:65:import_set_state_nolock()) ffff948a6e6df000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813298.194435:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:342c3357-8551-4188-a7af-8af88d224192+6:2395:x1875706301770624:12345-192.168.202.13@tcp:8:mount.lustre.0 Request processed in 209us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813298.194440:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00100000:3.0:1788813298.194452:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:3.0:1788813298.194455:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1875706301770752:12345-192.168.202.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788813298.194475:0:18668:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 342c3357-8551-4188-a7af-8af88d224192@192.168.202.13@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:3.0:1788813298.194486:0:18668:0:(genops.c:1384:class_connect()) connect: client 342c3357-8551-4188-a7af-8af88d224192, cookie 0xf32533d6ff704076 00002000:00100000:3.0:1788813298.194489:0:18668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 342c3357-8551-4188-a7af-8af88d224192/ffff948a6e6d9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788813298.194493:0:18668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788813298.194516:0:18668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788813298.194528:0:18668:0:(import.c:65:import_set_state_nolock()) ffff948a6e6dd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813298.194550:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:342c3357-8551-4188-a7af-8af88d224192+6:2395:x1875706301770752:12345-192.168.202.13@tcp:8:mount.lustre.0 Request processed in 92us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813298.194557:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:1.0:1788813298.195240:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301770880 00000100:00100000:1.0:1788813298.195247:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301770880 00000100:00100000:1.0:1788813298.195293:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4 00000100:00100000:1.0:1788813298.195301:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:342c3357-8551-4188-a7af-8af88d224192+6:15003:x1875706301770880:12345-192.168.202.13@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788813298.195355:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:342c3357-8551-4188-a7af-8af88d224192+6:15003:x1875706301770880:12345-192.168.202.13@tcp:900:mount.lustre.0 Request processed in 55us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813298.195362:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4 00000100:00100000:0.0:1788813298.198619:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813298.198800:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301771008 00000100:00100000:1.0:1788813298.198811:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301771008 00000100:00100000:1.0:1788813298.198866:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 1 00000100:00100000:1.0:1788813298.198877:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342c3357-8551-4188-a7af-8af88d224192+6:15003:x1875706301771008:12345-192.168.202.13@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788813298.201874:0:17166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788813298.202105:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342c3357-8551-4188-a7af-8af88d224192+6:15003:x1875706301771008:12345-192.168.202.13@tcp:33:mount.lustre.0 Request processed in 3225us (3489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813298.202120:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 1 00000100:00100000:0.0:1788813298.449138:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813298.449250:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301771136 00000100:00100000:1.0:1788813298.449260:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301771136 00000100:00100000:1.0:1788813298.449317:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:1.0:1788813298.449329:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342c3357-8551-4188-a7af-8af88d224192+6:15036:x1875706301771136:12345-192.168.202.13@tcp:101:mkdir.0 00010000:00010000:1.0:1788813298.449350:0:18693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813298.449373:0:18693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff70407d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729b66 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813298.449440:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff704084 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813298.449456:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff704084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813298.449468:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff704084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813298.449526:0:18693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788813298.449530:0:18693:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788813298.449551:0:18693:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff704084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813298.449577:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff70407d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b66 expref: 8 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813298.449597:0:18693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff704084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b66 expref: 7 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813298.449606:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe40a00) 00010000:00010000:1.0:1788813298.449610:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813298.449613:0:18693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9200, rc 0) 00000100:00100000:1.0:1788813298.449703:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342c3357-8551-4188-a7af-8af88d224192+7:15036:x1875706301771136:12345-192.168.202.13@tcp:101:mkdir.0 Request processed in 376us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813298.449711:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:2.0:1788813299.044172:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313371008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813299.044250:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813299.044272:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313371264:0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.044304:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813299.044316:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313371520:0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.044323:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313371776:0@lo:400:kworker.0 00000100:00100000:2.0:1788813299.044337:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813299.044343:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813299.044350:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313372032:0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.044357:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313372288:0@lo:400:kworker.0 00000100:00100000:2.0:1788813299.044368:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813299.044385:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313372544:0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.044388:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813299.044402:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313372800:0@lo:400:kworker.0 00000100:00100000:2.0:1788813299.044403:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813299.044418:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788813299.044423:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813299.044423:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313371136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813299.044440:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788813299.044441:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813299.044445:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313371392:0@lo:400:kworker.0 00000100:00100000:2.0:1788813299.044452:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313371648:0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.044464:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813299.044466:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813299.044479:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313372160:0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.044480:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313371904:0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.044496:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813299.044510:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313372416:0@lo:400:kworker.0 00000100:00100000:2.0:1788813299.044518:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813299.044530:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313372672:0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.044536:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813299.044545:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813299.044577:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313371776 00000100:00100000:3.0:1788813299.044585:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313371776 00000100:00100000:3.0:1788813299.044623:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313372288 00000100:00100000:3.0:1788813299.044636:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313372288 00000100:00100000:0.0:1788813299.044639:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313371264 00000100:00100000:0.0:1788813299.044643:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313371264 00000100:00100000:3.0:1788813299.044653:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313372544 00000100:00100000:3.0:1788813299.044655:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313372544 00000100:00100000:0.0:1788813299.044680:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788813299.044689:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+24:3625:x1875706313371264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.044702:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313372800 00000100:00100000:3.0:1788813299.044704:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313372800 00000100:00100000:3.0:1788813299.044721:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313372416 00000100:00100000:3.0:1788813299.044723:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313372416 00000100:00100000:0.0:1788813299.044731:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+24:3625:x1875706313371264:12345-0@lo:400:kworker.0 Request processed in 44us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813299.044736:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313372672 00000100:00100000:3.0:1788813299.044738:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313372672 00000100:00100000:0.0:1788813299.044744:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788813299.044751:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788813299.044756:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313371776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813299.044775:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313371520 00000100:00100000:0.0:1788813299.044778:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313371520 00000100:00100000:3.0:1788813299.044786:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313371776:12345-0@lo:400:kworker.0 Request processed in 30us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813299.044792:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788813299.044801:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313372032 00000100:00100000:0.0:1788813299.044804:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313372032 00000100:00100000:3.0:1788813299.044806:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788813299.044810:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313372288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813299.044814:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313371648 00000100:00100000:0.0:1788813299.044816:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313371648 00000100:00100000:0.0:1788813299.044826:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313372160 00000100:00100000:0.0:1788813299.044829:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313372160 00000100:00100000:3.0:1788813299.044845:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313372288:12345-0@lo:400:kworker.0 Request processed in 34us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813299.044851:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788813299.044852:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788813299.044858:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313371520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.044864:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788813299.044869:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313372544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.044891:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875706313372544:12345-0@lo:400:kworker.0 Request processed in 22us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813299.044892:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313371520:12345-0@lo:400:kworker.0 Request processed in 33us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813299.044897:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788813299.044898:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788813299.044908:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788813299.044913:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71411880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313372032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.044915:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788813299.044920:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313372800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813299.044955:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71411880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313372032:12345-0@lo:400:kworker.0 Request processed in 42us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813299.044959:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313372800:12345-0@lo:400:kworker.0 Request processed in 40us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813299.044961:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788813299.044965:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813299.044972:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813299.044976:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788813299.044977:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313371648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.044981:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313372416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.045001:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875706313372416:12345-0@lo:400:kworker.0 Request processed in 19us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813299.045001:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313371648:12345-0@lo:400:kworker.0 Request processed in 24us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813299.045007:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788813299.045007:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788813299.045017:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813299.045018:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788813299.045022:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313372160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.045023:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313372672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.045046:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875706313372672:12345-0@lo:400:kworker.0 Request processed in 23us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813299.045050:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313372160:12345-0@lo:400:kworker.0 Request processed in 28us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813299.045051:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788813299.045055:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813299.045072:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313371008 00000100:00100000:0.0:1788813299.045075:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313371008 00000100:00100000:3.0:1788813299.045078:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313371392 00000100:00100000:3.0:1788813299.045081:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313371392 00000100:00100000:0.0:1788813299.045089:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313371136 00000100:00100000:0.0:1788813299.045092:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313371136 00000100:00100000:3.0:1788813299.045099:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313371904 00000100:00100000:3.0:1788813299.045101:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313371904 00000100:00100000:0.0:1788813299.045101:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813299.045106:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a71413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313371008:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813299.045111:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813299.045115:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313371392:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788813299.045124:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788813299.045143:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313371392:12345-0@lo:400:kworker.0 Request processed in 28us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813299.045148:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a71413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313371008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813299.045149:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788813299.045152:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813299.045159:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788813299.045161:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788813299.045164:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313371904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813299.045165:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313371136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813299.045178:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788813299.045197:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313371904:12345-0@lo:400:kworker.0 Request processed in 32us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813299.045197:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313371136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813299.045202:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788813299.045203:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788813299.045224:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813299.045228:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813299.045230:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813299.045232:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788813299.045245:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313371392:0@lo:400:kworker.0 00000100:00100000:0.0:1788813299.045257:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313371904:0@lo:400:kworker.0 00000100:00100000:0.0:1788813299.045266:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1875706313372416:0@lo:400:kworker.0 00000100:00100000:0.0:1788813299.045273:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7e65740-fccd-471b-95df-6f83776cc95f:3625:1875706313371264:0@lo:400:kworker.0 00000100:00100000:0.0:1788813299.045281:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313371776:0@lo:400:kworker.0 00000100:00100000:0.0:1788813299.045299:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313372288:0@lo:400:kworker.0 00010000:00080000:0.0:1788813299.045308:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894435ce00 x1875706313372800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813299.045318:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313372800:0@lo:400:kworker.0 00000100:00100000:0.0:1788813299.045345:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813299.045351:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313372928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813299.045372:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813299.045414:0:3627:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788813299.045428:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313371136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813299.045436:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313371648:0@lo:400:kworker.0 00000100:00100000:0.0:1788813299.045444:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313372160:0@lo:400:kworker.0 00000100:00100000:0.0:1788813299.045452:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1875706313372672:0@lo:400:kworker.0 00000100:00100000:0.0:1788813299.045463:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313371520:0@lo:400:kworker.0 00000100:00100000:0.0:1788813299.045471:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313372032:0@lo:400:kworker.0 00010000:00080000:0.0:1788813299.045482:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94894435d180 x1875706313372544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813299.045487:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313372928 00000100:00100000:0.0:1788813299.045490:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1875706313372544:0@lo:400:kworker.0 00000100:00100000:3.0:1788813299.045491:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313372928 00000100:00100000:0.0:1788813299.045501:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313371008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813299.045506:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813299.045510:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313372928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788813299.045519:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788813299.045547:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313372928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813299.045553:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788813299.045559:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313372928:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788813299.109333:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813300.132107:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788813301.053413:0:20041:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788813301.096071:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894435ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313373056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813301.096142:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813301.096197:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313373056 00000100:00100000:3.0:1788813301.096205:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313373056 00000100:00100000:3.0:1788813301.096256:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788813301.096265:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313373056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788813301.096293:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788813301.096336:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313373056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813301.096342:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788813301.096364:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813301.096399:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894435ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313373056:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1788813301.104081:0:18665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 342c3357-8551-4188-a7af-8af88d224192 00000001:00100000:2.0:1788813301.104094:0:18665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 39adb0c8-c140-4b12-b8dc-f0861ff799f7 00000001:00100000:3.0:1788813301.104301:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 342c3357-8551-4188-a7af-8af88d224192 00000001:00100000:3.0:1788813301.104310:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 39adb0c8-c140-4b12-b8dc-f0861ff799f7 00000001:00100000:2.0:1788813301.108282:0:19483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 342c3357-8551-4188-a7af-8af88d224192 00000001:00100000:2.0:1788813301.108294:0:19483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 39adb0c8-c140-4b12-b8dc-f0861ff799f7 00000001:00100000:0.0:1788813301.108344:0:17895:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 342c3357-8551-4188-a7af-8af88d224192 00000001:00100000:0.0:1788813301.108350:0:17895:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 39adb0c8-c140-4b12-b8dc-f0861ff799f7 00010000:00010000:0.0:1788813301.160960:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813302.126258:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813302.126284:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313373184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813302.126365:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813302.126452:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313373184 00000100:00100000:1.0:1788813302.126461:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313373184 00000100:00100000:1.0:1788813302.126512:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788813302.126523:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313373184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788813302.126561:0:17902:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788813302.126610:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313373184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.126631:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788813302.126689:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313373184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813302.127320:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313373312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788813302.127357:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813302.127404:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313373312 00000100:00100000:0.0:1788813302.127408:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313373312 00000100:00100000:0.0:1788813302.127436:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788813302.127442:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313373312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813302.127463:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788813302.127500:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313373312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813302.127506:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788813302.127538:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313373312:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788813302.184219:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813303.206726:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813303.680472:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813303.680508:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813303.680526:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813303.680540:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813303.680561:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813303.680592:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813303.680617:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813303.680649:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813303.680671:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813303.680688:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301771392 00000100:00100000:3.0:1788813303.680697:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301771648 00000100:00100000:0.0:1788813303.680701:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301771392 00000100:00100000:3.0:1788813303.680702:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301771648 00000100:00100000:3.0:1788813303.680753:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301772160 00000100:00100000:3.0:1788813303.680756:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301772160 00000100:00100000:3.0:1788813303.680767:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301771776 00000100:00100000:3.0:1788813303.680769:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301771776 00000100:00100000:3.0:1788813303.680783:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301772288 00000100:00100000:3.0:1788813303.680786:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301772288 00000100:00100000:3.0:1788813303.680811:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:0.0:1788813303.680818:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301771904 00000100:00100000:3.0:1788813303.680822:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2398:x1875706301771648:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813303.680824:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301771904 00000100:00100000:0.0:1788813303.680847:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301771520 00000100:00100000:3.0:1788813303.680910:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2398:x1875706301771648:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 90us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813303.680918:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:3.0:1788813303.680956:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00100000:3.0:1788813303.680963:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:342c3357-8551-4188-a7af-8af88d224192+5:2398:x1875706301772160:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813303.680986:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:342c3357-8551-4188-a7af-8af88d224192+5:2398:x1875706301772160:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813303.680999:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00100000:3.0:1788813303.681012:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:3.0:1788813303.681018:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2398:x1875706301771776:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813303.681040:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301771520 00000100:00100000:3.0:1788813303.681046:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2398:x1875706301771776:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813303.681053:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:3.0:1788813303.681068:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:0.0:1788813303.681073:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301772032 00000100:00100000:3.0:1788813303.681076:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:342c3357-8551-4188-a7af-8af88d224192+5:2398:x1875706301772288:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813303.681078:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301772032 00000100:00100000:3.0:1788813303.681110:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:342c3357-8551-4188-a7af-8af88d224192+5:2398:x1875706301772288:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 35us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813303.681118:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:0.0:1788813303.681182:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00100000:0.0:1788813303.681193:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2398:x1875706301771392:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813303.681229:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2398:x1875706301771392:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 39us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813303.681266:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 47 00000100:00100000:3.0:1788813303.681275:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342c3357-8551-4188-a7af-8af88d224192+6:2398:x1875706301771904:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813303.681306:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342c3357-8551-4188-a7af-8af88d224192+6:2398:x1875706301771904:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 33us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813303.681313:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 47 00000100:00100000:3.0:1788813303.681330:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 48 00000100:00100000:3.0:1788813303.681338:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2398:x1875706301771520:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813303.681377:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2398:x1875706301771520:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 41us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813303.681384:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 48 00000100:00100000:3.0:1788813303.681397:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 49 00000100:00100000:3.0:1788813303.681409:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342c3357-8551-4188-a7af-8af88d224192+5:2398:x1875706301772032:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813303.681432:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342c3357-8551-4188-a7af-8af88d224192+5:2398:x1875706301772032:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813303.681438:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 49 00000100:00100000:3.0:1788813303.681463:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301771264 00000100:00100000:3.0:1788813303.681466:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301771264 00000100:00100000:3.0:1788813303.681492:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 145 00000100:00100000:3.0:1788813303.681500:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:2398:x1875706301771264:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813303.681520:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:2398:x1875706301771264:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 22us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813303.681526:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 145 00000100:00080000:3.0:1788813303.681570:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813303.681574:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813303.681577:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813303.681593:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813303.687823:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00100000:2.0:1788813304.165415:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313373440:0@lo:400:kworker.0 00000100:00100000:2.0:1788813304.165490:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813304.165663:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313373440 00000100:00100000:3.0:1788813304.165672:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313373440 00000100:00100000:3.0:1788813304.165732:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788813304.165742:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+24:3626:x1875706313373440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813304.165799:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+24:3626:x1875706313373440:12345-0@lo:400:kworker.0 Request processed in 59us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813304.165806:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788813304.166111:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313373440:0@lo:400:kworker.0 00000100:00100000:1.0:1788813304.166560:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313373824:0@lo:400:kworker.0 00000100:00100000:3.0:1788813304.166653:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313373696:0@lo:400:kworker.0 00000100:00100000:3.0:1788813304.166685:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813304.166709:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313374208:0@lo:400:kworker.0 00000100:00100000:3.0:1788813304.166740:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813304.166772:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313374720:0@lo:400:kworker.0 00000100:00100000:3.0:1788813304.166795:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813304.166815:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788813304.166821:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313373568:0@lo:400:kworker.0 00000100:00100000:3.0:1788813304.166843:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813304.166861:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313374080:0@lo:400:kworker.0 00000100:00100000:3.0:1788813304.166879:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813304.166892:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313374592:0@lo:400:kworker.0 00000100:00100000:3.0:1788813304.166910:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813304.166958:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313373696 00000100:00100000:3.0:1788813304.166962:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313373696 00000100:00100000:3.0:1788813304.166999:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313374208 00000100:00100000:3.0:1788813304.167003:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313374208 00000100:00100000:3.0:1788813304.167021:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788813304.167027:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313373696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813304.167078:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313373696:12345-0@lo:400:kworker.0 Request processed in 50us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813304.167083:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788813304.167220:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788813304.167227:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313374208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813304.167255:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313374208:12345-0@lo:400:kworker.0 Request processed in 29us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813304.167260:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788813304.167281:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313374720 00000100:00100000:3.0:1788813304.167285:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313374720 00000100:00100000:3.0:1788813304.167311:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313374592 00000100:00100000:1.0:1788813304.167431:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813304.167454:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313374336:0@lo:400:kworker.0 00000100:00100000:1.0:1788813304.167475:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813304.167491:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313374848:0@lo:400:kworker.0 00000100:00100000:1.0:1788813304.167510:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813304.167527:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788813304.167533:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313373952:0@lo:400:kworker.0 00000100:00100000:1.0:1788813304.167553:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813304.167563:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313374464:0@lo:400:kworker.0 00000100:00100000:0.0:1788813304.167742:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313373568 00000100:00100000:0.0:1788813304.167747:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313373568 00000100:00100000:0.0:1788813304.167775:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313374080 00000100:00100000:0.0:1788813304.167778:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313374080 00000100:00100000:0.0:1788813304.167791:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788813304.167797:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313373568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813304.167834:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313373568:12345-0@lo:400:kworker.0 Request processed in 37us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.167840:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788813304.167860:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813304.167866:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313374080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813304.167894:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313374080:12345-0@lo:400:kworker.0 Request processed in 28us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.167900:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813304.167926:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313374848 00000100:00100000:0.0:1788813304.167946:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313374848 00000100:00100000:0.0:1788813304.167965:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313373952 00000100:00100000:0.0:1788813304.167968:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313373952 00000100:00100000:0.0:1788813304.167981:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813304.167987:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894435c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313374720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813304.168016:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894435c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313374720:12345-0@lo:400:kworker.0 Request processed in 29us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.168021:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813304.168036:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788813304.168041:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313374848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813304.168079:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875706313374848:12345-0@lo:400:kworker.0 Request processed in 38us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.168085:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788813304.168253:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313374592 00000100:00100000:3.0:1788813304.168280:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788813304.168284:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313373952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813304.168314:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875706313373952:12345-0@lo:400:kworker.0 Request processed in 30us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813304.168318:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788813304.168554:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813304.168560:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313374592:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788813304.168802:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813304.168807:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788813304.168810:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813304.168820:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313373824 00000100:00100000:3.0:1788813304.168824:0:18671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313373824 00000100:00100000:0.0:1788813304.168892:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313374592:12345-0@lo:400:kworker.0 Request processed in 331us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.168898:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788813304.169259:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313374336 00000100:00100000:3.0:1788813304.169264:0:18671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313374336 00000100:00100000:0.0:1788813304.169311:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788813304.169439:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813304.169463:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313374976:0@lo:400:kworker.0 00000100:00100000:1.0:1788813304.169486:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813304.169512:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1875706313374848:0@lo:400:kworker.0 00000100:00100000:1.0:1788813304.169528:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875706313373952:0@lo:400:kworker.0 00000100:00100000:1.0:1788813304.169555:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313374464 00000100:00100000:1.0:1788813304.169557:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313374464 00000100:00100000:1.0:1788813304.169577:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313374976 00000100:00100000:1.0:1788813304.169590:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313374976 00000100:00100000:0.0:1788813304.169611:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313373824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813304.169659:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313373824:12345-0@lo:400:kworker.0 Request processed in 49us (2227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.169665:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813304.169687:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788813304.169694:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313374464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813304.169732:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875706313374464:12345-0@lo:400:kworker.0 Request processed in 39us (2151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.169737:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788813304.169765:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875706313374464:0@lo:400:kworker.0 00000100:00100000:0.0:1788813304.169775:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313373824:0@lo:400:kworker.0 00000100:00080000:2.0:1788813304.171453:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788813304.171463:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813304.171486:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313375104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813304.171545:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813304.171576:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813304.171583:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313375232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813304.171603:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813304.171639:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788813304.171641:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313375104 00000100:00100000:2.0:1788813304.171647:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313375104 00000100:00100000:1.0:1788813304.171649:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313374976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813304.171666:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313375232 00000100:00100000:2.0:1788813304.171667:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313375232 00000100:00100000:2.0:1788813304.171679:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788813304.171684:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3627:x1875706313375104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813304.171704:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788813304.171708:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875706313374976:12345-0@lo:400:kworker.0 Request processed in 62us (2219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813304.171713:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788813304.171809:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3627:x1875706313375104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813304.171817:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788813304.171830:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788813304.171836:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313375232:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813304.171877:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813304.171886:0:18671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313374336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813304.171920:0:18671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313374336:12345-0@lo:400:kworker.0 Request processed in 37us (4445us total) trans 0 rc 0/0 00002000:00000024:2.0:1788813304.171925:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788813304.171926:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788813304.171971:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313375232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813304.171983:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788813304.172035:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e05880 x1875706313374976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813304.172048:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1875706313374976:0@lo:400:kworker.0 00000100:00100000:0.0:1788813304.172073:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313374336:0@lo:400:kworker.0 00000100:00100000:2.0:1788813304.172208:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313375232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813304.172221:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313375104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788813304.172347:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313373568:0@lo:400:kworker.0 00000100:00100000:2.0:1788813304.172357:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313374080:0@lo:400:kworker.0 00000100:00100000:2.0:1788813304.172367:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313374592:0@lo:400:kworker.0 00000100:00100000:2.0:1788813304.172376:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313373696:0@lo:400:kworker.0 00000100:00100000:2.0:1788813304.172387:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313374208:0@lo:400:kworker.0 00010000:00080000:2.0:1788813304.172399:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948942e07100 x1875706313374720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813304.172408:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313374720:0@lo:400:kworker.0 00000100:00100000:2.0:1788813304.172453:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813304.172462:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313375360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813304.172487:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813304.172523:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313375360 00000100:00100000:0.0:1788813304.172528:0:18672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313375360 00000100:00100000:0.0:1788813304.172554:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813304.172560:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a76406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313375360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813304.172571:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788813304.172684:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a76406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313375360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.172690:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788813304.172810:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313375360:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788813304.235543:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788813304.349923:0:20189:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd14a82640 20000000:00000080:3.0:1788813304.350385:0:20189:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff948a6e647c00 uarg=0000000000000000 20000000:01000000:3.0:1788813304.350448:0:20189:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788813304.350454:0:20189:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788813304.350458:0:20189:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788813304.356107:0:20190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788813304.356441:0:20189:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788813304.369221:0:20189:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788813304.369255:0:20189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948943657800/0xf32533d6ff70408b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.369276:0:20189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a43dacc00/0xf32533d6ff703d20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703d19 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.369285:0:20189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a43dac200/0xf32533d6ff703d2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703d27 expref: 23 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.369307:0:20189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703d66 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.369396:0:20189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a44cda800/0xf32533d6ff703e07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff703e00 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.369405:0:20189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a7b5f8e00/0xf32533d6ff70401b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ac5 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.369412:0:20189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff70405a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b35 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.369419:0:20189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948943657800/0xf32533d6ff70408b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.369465:0:20189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff70405a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b35 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.369482:0:20189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff70405a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b35 expref: 12 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813304.369497:0:20189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944170380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875706313375488:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813304.370053:0:20189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a7b5f8e00/0xf32533d6ff70401b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ac5 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.370064:0:20189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a7b5f8e00/0xf32533d6ff70401b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ac5 expref: 12 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813304.370073:0:20189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944170700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875706313375616:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813304.370126:0:20189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a44cda800/0xf32533d6ff703e07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff703e00 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.370134:0:20189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a44cda800/0xf32533d6ff703e07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff703e00 expref: 23 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813304.370144:0:20189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944171180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875706313375744:0@lo:104: 00000100:00100000:3.0:1788813304.370185:0:20189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813304.370221:0:20189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff703d66 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.370229:0:20189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703d6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff703d66 expref: 23 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813304.370237:0:20189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944172680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875706313375872:0@lo:104: 00000100:00100000:3.0:1788813304.370259:0:20189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813304.370283:0:20189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a43dac200/0xf32533d6ff703d2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff703d27 expref: 23 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.370291:0:20189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a43dac200/0xf32533d6ff703d2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff703d27 expref: 23 pid: 17156 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813304.370300:0:20189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944170e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875706313376000:0@lo:104: 00000100:00100000:3.0:1788813304.370335:0:20189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813304.370352:0:20189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948a43dacc00/0xf32533d6ff703d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf32533d6ff703d19 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.370360:0:20189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948a43dacc00/0xf32533d6ff703d20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf32533d6ff703d19 expref: 23 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813304.370380:0:20189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944173800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875706313376128:0@lo:104: 00000100:00100000:3.0:1788813304.370402:0:20189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813304.370412:0:20189:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a600ef000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813304.370514:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313375744 00000100:00100000:1.0:1788813304.370522:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313375744 00000100:00100000:1.0:1788813304.370562:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313375872 00000100:00100000:1.0:1788813304.370566:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313375872 00000100:00100000:1.0:1788813304.370589:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313376000 00000100:00100000:1.0:1788813304.370592:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313376000 00000100:00100000:1.0:1788813304.370603:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313376128 00000100:00100000:1.0:1788813304.370605:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313376128 00000100:00100000:1.0:1788813304.370628:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813304.370638:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7e65740-fccd-471b-95df-6f83776cc95f+6:20189:x1875706313375744:12345-0@lo:104: 00010000:00010000:1.0:1788813304.370650:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a43dace00/0xf32533d6ff703e00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703e07 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.370726:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813304.370733:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7e65740-fccd-471b-95df-6f83776cc95f+6:20189:x1875706313375744:12345-0@lo:104: Request processed in 98us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813304.370740:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813304.370759:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813304.370766:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944171500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7e65740-fccd-471b-95df-6f83776cc95f+5:20189:x1875706313375872:12345-0@lo:104: 00010000:00010000:1.0:1788813304.370774:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948943656200/0xf32533d6ff703d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703d6d expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.370807:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813304.370812:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944171500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7e65740-fccd-471b-95df-6f83776cc95f+5:20189:x1875706313375872:12345-0@lo:104: Request processed in 48us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813304.370828:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813304.370842:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813304.370848:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944170a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7e65740-fccd-471b-95df-6f83776cc95f+4:20189:x1875706313376000:12345-0@lo:104: 00010000:00010000:1.0:1788813304.370855:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a43dad800/0xf32533d6ff703d27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703d2e expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.370890:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788813304.370895:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944170a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7e65740-fccd-471b-95df-6f83776cc95f+4:20189:x1875706313376000:12345-0@lo:104: Request processed in 48us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813304.370900:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813304.370913:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813304.370919:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7e65740-fccd-471b-95df-6f83776cc95f+3:20189:x1875706313376128:12345-0@lo:104: 00010000:00010000:1.0:1788813304.370926:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff703d19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703d20 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.370973:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788813304.370978:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7e65740-fccd-471b-95df-6f83776cc95f+3:20189:x1875706313376128:12345-0@lo:104: Request processed in 60us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813304.370983:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788813304.371001:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788813304.371006:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a43dace00/0xf32533d6ff703e00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703e07 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371012:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dace00 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813304.371017:0:19586:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a43dace00/0xf32533d6ff703e00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff703e07 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371036:0:19586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a43dace00/0xf32533d6ff703e00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff703e07 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813304.371043:0:19586:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a43dace00/0xf32533d6ff703e00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff703e07 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813304.371049:0:19586:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813304.371081:0:19586:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a43dace00/0xf32533d6ff703e00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703e07 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371087:0:19586:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813304.371107:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a43dace00/0xf32533d6ff703e00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703e07 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371114:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a43dace00/0xf32533d6ff703e00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703e07 expref: -99 pid: 19482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371127:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788813304.371130:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948943656200/0xf32533d6ff703d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703d6d expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371135:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656200 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813304.371137:0:19586:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948943656200/0xf32533d6ff703d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff703d6d expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371143:0:19586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948943656200/0xf32533d6ff703d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff703d6d expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813304.371149:0:19586:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948943656200/0xf32533d6ff703d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff703d6d expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813304.371159:0:19586:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813304.371171:0:19586:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948943656200/0xf32533d6ff703d66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703d6d expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371178:0:19586:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813304.371193:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948943656200/0xf32533d6ff703d66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703d6d expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371199:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948943656200/0xf32533d6ff703d66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703d6d expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371208:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813304.371210:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a43dad800/0xf32533d6ff703d27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703d2e expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371216:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a43dad800 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813304.371219:0:19586:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a43dad800/0xf32533d6ff703d27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff703d2e expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371225:0:19586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a43dad800/0xf32533d6ff703d27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff703d2e expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813304.371231:0:19586:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a43dad800/0xf32533d6ff703d27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff703d2e expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813304.371235:0:19586:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813304.371246:0:19586:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a43dad800/0xf32533d6ff703d27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703d2e expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371252:0:19586:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813304.371264:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a43dad800/0xf32533d6ff703d27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703d2e expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371270:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a43dad800/0xf32533d6ff703d27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703d2e expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371281:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813304.371284:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff703d19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf32533d6ff703d20 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371289:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb400 already unused, calling callback (ffffffffc13c1c20) 10000000:00010000:1.0:1788813304.371292:0:19586:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff703d19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf32533d6ff703d20 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371299:0:19586:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff703d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf32533d6ff703d20 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813304.371305:0:19586:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff703d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf32533d6ff703d20 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813304.371310:0:19586:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813304.371323:0:19586:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff703d19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703d20 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371329:0:19586:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813304.371334:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff703d19 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703d20 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371339:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff948a44cdb400/0xf32533d6ff703d19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf32533d6ff703d20 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371363:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813304.371365:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813304.371366:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813304.371374:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813304.371379:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813304.371397:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313376256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813304.371427:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813304.371457:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813304.371463:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313376640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813304.371483:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813304.371516:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313376384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813304.371539:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813304.371559:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813304.371564:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313376512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813304.371583:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813304.371608:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313376256 00000100:00100000:1.0:1788813304.371626:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313376256 00010000:00010000:1.0:1788813304.371647:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a44cda800/0xf32533d6ff703e07 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703e00 expref: 24 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813304.371661:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313376640 00000100:00100000:1.0:1788813304.371664:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313376640 00010000:00010000:1.0:1788813304.371673:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a43dacc00/0xf32533d6ff703d20 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703d19 expref: 25 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813304.371683:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313376384 00000100:00100000:1.0:1788813304.371686:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313376384 00010000:00010000:1.0:1788813304.371705:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703d6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703d66 expref: 26 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813304.371715:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313376512 00000100:00100000:1.0:1788813304.371718:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313376512 00010000:00010000:1.0:1788813304.371728:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a43dac200/0xf32533d6ff703d2e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703d27 expref: 27 pid: 17156 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813304.371740:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813304.371746:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+27:3626:x1875706313376256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813304.371756:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813304.371761:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a44cda800/0xf32533d6ff703e07 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703e00 expref: 27 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371771:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a44cda800/0xf32533d6ff703e07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff703e00 expref: 27 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371785:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813304.371813:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+27:3626:x1875706313376256:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813304.371819:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813304.371835:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813304.371841:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+26:3626:x1875706313376640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813304.371848:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813304.371851:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a43dacc00/0xf32533d6ff703d20 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703d19 expref: 26 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371858:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a43dacc00/0xf32533d6ff703d20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff703d19 expref: 26 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371877:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813304.371899:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+26:3626:x1875706313376640:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813304.371905:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813304.371917:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813304.371922:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+25:3627:x1875706313376384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813304.371929:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813304.371965:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703d6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703d66 expref: 25 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371972:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703d6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff703d66 expref: 25 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.371980:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813304.372006:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+25:3627:x1875706313376384:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813304.372012:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813304.372023:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813304.372029:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+24:3627:x1875706313376512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813304.372050:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813304.372055:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a43dac200/0xf32533d6ff703d2e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf32533d6ff703d27 expref: 24 pid: 17156 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.372064:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a43dac200/0xf32533d6ff703d2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf32533d6ff703d27 expref: 24 pid: 17156 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.372073:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813304.372099:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7e65740-fccd-471b-95df-6f83776cc95f+24:3627:x1875706313376512:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813304.372105:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813304.372144:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313376512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813304.372152:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7e65740-fccd-471b-95df-6f83776cc95f:3627:1875706313376384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813304.372175:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313376640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813304.372182:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7e65740-fccd-471b-95df-6f83776cc95f:3626:1875706313376256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813304.372360:0:20189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a44cda800/0xf32533d6ff703e07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff703e00 expref: 23 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813304.372373:0:20189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944171180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875706313375744:0@lo:104: 00010000:00010000:3.0:1788813304.372382:0:20189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc09800/0xf32533d6ff703d6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff703d66 expref: 22 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813304.372389:0:20189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944172680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875706313375872:0@lo:104: 00010000:00010000:3.0:1788813304.372398:0:20189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a43dac200/0xf32533d6ff703d2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff703d27 expref: 21 pid: 17156 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813304.372405:0:20189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944170e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875706313376000:0@lo:104: 00010000:00010000:3.0:1788813304.372414:0:20189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a43dacc00/0xf32533d6ff703d20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf32533d6ff703d19 expref: 20 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813304.372422:0:20189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944173800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875706313376128:0@lo:104: 00000100:00100000:3.0:1788813304.390449:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813304.390481:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813304.390730:0:20189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944170380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875706313375488:192.168.202.13@tcp:104: 00000100:00100000:0.0:1788813304.390744:0:20189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944170700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875706313375616:192.168.202.13@tcp:104: 00010000:00010000:0.0:1788813304.390787:0:20189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948943657800/0xf32533d6ff70408b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813304.391065:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301772416 00000100:00100000:2.0:1788813304.391073:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301772416 00010000:00010000:2.0:1788813304.391119:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a7b5f8e00/0xf32533d6ff70401b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ac5 expref: 13 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813304.391192:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301772544 00000100:00100000:2.0:1788813304.391217:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301772544 00010000:00010000:2.0:1788813304.391233:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff70405a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b35 expref: 14 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813304.391250:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:2.0:1788813304.391259:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ca6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+14:2397:x1875706301772416:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813304.391273:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813304.391279:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a7b5f8e00/0xf32533d6ff70401b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ac5 expref: 14 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.391289:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a7b5f8e00/0xf32533d6ff70401b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ac5 expref: 14 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.391306:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a7b5f8e00/0xf32533d6ff70401b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ac5 expref: 14 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.391330:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813304.391385:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ca6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:2397:x1875706301772416:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 127us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813304.391393:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:2.0:1788813304.391439:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00100000:2.0:1788813304.391446:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944173480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+12:2396:x1875706301772544:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813304.391453:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813304.391459:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff70405a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b35 expref: 12 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.391468:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff70405a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b35 expref: 12 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.391489:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948a6fc08c00/0xf32533d6ff70405a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b35 expref: 12 pid: 17154 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.391501:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948943657800/0xf32533d6ff70408b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.391509:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948943657800/0xf32533d6ff70408b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.391524:0:17148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948943657800/0xf32533d6ff70408b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.391531:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948943657800/0xf32533d6ff70408b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.391539:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948943657800/0xf32533d6ff70408b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.391546:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948943657800/0xf32533d6ff70408b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.391552:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657800 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:2.0:1788813304.391557:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948943657800/0xf32533d6ff70408b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.391565:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948943657800/0xf32533d6ff70408b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.392243:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948943657800/0xf32533d6ff70408b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.392267:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813304.392299:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944173480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:2396:x1875706301772544:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 852us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813304.392306:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 14 00010000:00010000:0.0:1788813304.392590:0:20189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948943657800/0xf32533d6ff70408b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.392600:0:20189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948943657800/0xf32533d6ff70408b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.392606:0:20189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948943657800/0xf32533d6ff70408b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.254180:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813305.606834:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813305.607013:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301772672 00000100:00100000:1.0:1788813305.607025:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301772672 00000100:00100000:1.0:1788813305.607082:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 147 00000100:00100000:1.0:1788813305.607093:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+11:14884:x1875706301772672:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813305.607109:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813305.607127:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff704092 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729b6d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.607153:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff704092 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b6d expref: 12 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.607164:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8a00/0xf32533d6ff704092 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b6d expref: 12 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.607173:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8a00, rc 0) 00000100:00100000:1.0:1788813305.607236:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+12:14884:x1875706301772672:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 Request processed in 146us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813305.607243:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 147 00000100:00100000:3.0:1788813305.612423:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813305.612469:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301772800 00000100:00100000:3.0:1788813305.612485:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301772800 00000100:00100000:3.0:1788813305.612543:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 148 00000100:00100000:3.0:1788813305.612554:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+12:14884:x1875706301772800:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813305.612802:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+12:14884:x1875706301772800:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 Request processed in 247us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813305.612815:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 148 00000100:00100000:3.0:1788813305.618481:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813305.621439:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301772928 00000100:00100000:0.0:1788813305.621452:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301772928 00000100:00100000:0.0:1788813305.621516:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 149 00000100:00100000:0.0:1788813305.621535:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+12:14884:x1875706301772928:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813305.621764:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+12:14884:x1875706301772928:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 Request processed in 230us (3289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813305.621772:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 149 00000100:00100000:1.0:1788813305.636123:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813305.636174:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301773056 00000100:00100000:1.0:1788813305.636184:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301773056 00000100:00100000:1.0:1788813305.639217:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 150 00000100:00100000:1.0:1788813305.639237:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+12:14884:x1875706301773056:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813305.639256:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813305.639274:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff704099 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x709a1244a0729b74 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.639302:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff704099 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b74 expref: 13 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.639313:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f9400/0xf32533d6ff704099 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b74 expref: 13 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.639321:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9400, rc 0) 00000100:00100000:1.0:1788813305.639390:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:14884:x1875706301773056:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 Request processed in 162us (3277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813305.639397:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 150 00000040:00080000:1.0:1788813305.641557:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788813305.643333:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813305.643395:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301773184 00000100:00100000:0.0:1788813305.643405:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301773184 00000100:00100000:0.0:1788813305.643458:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 151 00000100:00100000:0.0:1788813305.643469:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:14884:x1875706301773184:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813305.643643:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:14884:x1875706301773184:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 Request processed in 174us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813305.643652:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 151 00000100:00100000:1.0:1788813305.647023:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813305.647223:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301773312 00000100:00100000:3.0:1788813305.647233:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301773312 00000100:00100000:3.0:1788813305.647290:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 152 00000100:00100000:3.0:1788813305.647312:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:14884:x1875706301773312:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813305.647466:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:14884:x1875706301773312:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 Request processed in 165us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813305.647474:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 152 10000000:01000000:1.0:1788813306.020171:0:17160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813306.020180:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a7ccad800 from 13 10000000:01000000:1.0:1788813306.020186:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813306.020239:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813306.020252:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813306.020264:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813306.020493:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313376768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.023291:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813306.023396:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894229aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813306.026124:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313376768 00000100:00100000:3.0:1788813306.026139:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313376768 00000100:00100000:3.0:1788813306.026211:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788813306.026221:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+20:17160:x1875706313376768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813306.026241:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813306.026261:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948943656c00/0xf32533d6ff7040a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7040a0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813306.026293:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948943656c00/0xf32533d6ff7040a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7040a0 expref: 21 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813306.026306:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948943656c00/0xf32533d6ff7040a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7040a0 expref: 21 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813306.026316:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656c00, rc 0) 00000100:00100000:3.0:1788813306.026419:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+21:17160:x1875706313376768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (3136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813306.026427:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788813306.026466:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313376768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813306.026486:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040a7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813306.026655:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7040a7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813306.026868:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313376896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.026903:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813306.027153:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894229aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813306.027249:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313376896 00000100:00100000:3.0:1788813306.027255:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313376896 00000100:00100000:3.0:1788813306.027283:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788813306.027290:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+21:17160:x1875706313376896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813306.027965:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+21:17160:x1875706313376896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 672us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813306.027972:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788813306.028455:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313376896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.029149:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.029217:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813306.029252:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894229aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813306.029272:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313377024 00000100:00100000:1.0:1788813306.029278:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313377024 00000100:00100000:1.0:1788813306.029321:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788813306.029328:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+22:17160:x1875706313377024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.030958:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+21:17160:x1875706313377024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1628us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813306.030968:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788813306.031104:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788813306.035985:0:20257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788813306.036190:0:17160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788813306.036225:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813306.036237:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040a7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813306.036259:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8800/0xf32533d6ff7040a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040a7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813306.036270:0:17160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813306.036273:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948943443000 from 13 10000000:01000000:2.0:1788813306.036275:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813306.036322:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813306.036331:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813306.036342:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813306.036367:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813306.036433:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813306.036492:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943613d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813306.037174:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313377152 00000100:00100000:3.0:1788813306.037183:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313377152 00000100:00100000:3.0:1788813306.037229:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788813306.037240:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+21:17160:x1875706313377152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813306.037257:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813306.037273:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948943657800/0xf32533d6ff7040b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7040ae expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813306.037301:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948943657800/0xf32533d6ff7040b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7040ae expref: 22 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813306.037312:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948943657800/0xf32533d6ff7040b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7040ae expref: 22 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813306.037321:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943657800, rc 0) 00000100:00100000:3.0:1788813306.037371:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+22:17160:x1875706313377152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813306.037388:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788813306.037554:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813306.037581:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040b5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813306.037591:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7040b5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813306.037670:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813306.037819:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813306.037853:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943613d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813306.037881:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313377280 00000100:00100000:1.0:1788813306.037887:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313377280 00000100:00100000:1.0:1788813306.037925:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788813306.037965:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+22:17160:x1875706313377280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.038083:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+22:17160:x1875706313377280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813306.038090:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788813306.038115:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813306.038147:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813306.038188:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813306.038212:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff948943613d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813306.038225:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313377408 00000100:00100000:1.0:1788813306.038230:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313377408 00000100:00100000:1.0:1788813306.038271:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788813306.038279:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+22:17160:x1875706313377408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.038359:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+22:17160:x1875706313377408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813306.038366:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788813306.038408:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788813306.039152:0:20258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788813306.039206:0:17160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788813306.039226:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813306.039234:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040b5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813306.039244:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a6fc08a00/0xf32533d6ff7040ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040b5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813306.039255:0:17160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813306.039258:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948a7b569800 from 13 10000000:01000000:1.0:1788813306.039261:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813306.039291:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813306.039306:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813306.039316:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813306.039333:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.039370:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813306.039389:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894229af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813306.039404:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313377536 00000100:00100000:1.0:1788813306.039407:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313377536 00000100:00100000:1.0:1788813306.039438:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788813306.039445:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+22:17160:x1875706313377536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813306.039454:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813306.039464:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7040c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7040bc expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813306.039483:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7040c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7040bc expref: 23 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813306.039492:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a7b5f8200/0xf32533d6ff7040c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7040bc expref: 23 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813306.039499:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8200, rc 0) 00000100:00100000:1.0:1788813306.039528:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:17160:x1875706313377536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813306.039533:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788813306.039576:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813306.039589:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813306.039615:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7040c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813306.039672:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.039701:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813306.039714:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894229af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813306.039725:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313377664 00000100:00100000:1.0:1788813306.039728:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313377664 00000100:00100000:1.0:1788813306.039750:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788813306.039756:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:17160:x1875706313377664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.039842:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:17160:x1875706313377664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813306.039849:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788813306.039880:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.039905:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.039971:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813306.039986:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894229af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813306.039998:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313377792 00000100:00100000:1.0:1788813306.040002:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313377792 00000100:00100000:1.0:1788813306.040027:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788813306.040034:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:17160:x1875706313377792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.040111:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:17160:x1875706313377792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813306.040125:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788813306.040167:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788813306.050952:0:20260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788813306.051252:0:17160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788813306.051281:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813306.051294:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813306.051307:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a7b5f9a00/0xf32533d6ff7040bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040c3 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813306.051318:0:17160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813306.051320:0:17160:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9489437db000 from 13 10000000:01000000:1.0:1788813306.051323:0:17160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813306.051362:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813306.051371:0:17160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813306.051382:0:17160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813306.051409:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.051477:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813306.051528:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894229af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813306.053254:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313377920 00000100:00100000:0.0:1788813306.053267:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313377920 00000100:00100000:0.0:1788813306.053334:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788813306.053345:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+23:17160:x1875706313377920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813306.053362:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813306.053380:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948a44cdac00/0xf32533d6ff7040d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf32533d6ff7040ca expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813306.053411:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948a44cdac00/0xf32533d6ff7040d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf32533d6ff7040ca expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813306.053422:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948a44cdac00/0xf32533d6ff7040d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf32533d6ff7040ca expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813306.053431:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdac00, rc 0) 00000100:00100000:0.0:1788813306.053497:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+24:17160:x1875706313377920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (2020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813306.053516:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788813306.053653:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313377920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813306.053670:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040d1 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813306.053686:0:17160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf32533d6ff7040d1 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813306.053754:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313378048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.053784:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813306.053846:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894229af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788813306.053876:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313378048 00000100:00100000:3.0:1788813306.053881:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313378048 00000100:00100000:3.0:1788813306.053964:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788813306.053973:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+24:17160:x1875706313378048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813306.054082:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7e65740-fccd-471b-95df-6f83776cc95f+24:17160:x1875706313378048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813306.054090:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788813306.054193:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313378048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813306.054232:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313378176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813306.054292:0:17160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813306.055705:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff9489436133c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813306.061955:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313378176 00000100:00100000:1.0:1788813306.061971:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313378176 00000100:00100000:1.0:1788813306.062039:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788813306.062049:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+24:17160:x1875706313378176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813306.062216:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+24:17160:x1875706313378176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (7923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813306.062224:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788813306.062376:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7e65740-fccd-471b-95df-6f83776cc95f:17160:1875706313378176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788813306.063675:0:20261:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788813306.063851:0:17160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788813306.063873:0:17160:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813306.063884:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040d1 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813306.063896:0:17160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff948a7b5f8000/0xf32533d6ff7040ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf32533d6ff7040d1 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813306.213989:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313378304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788813306.214060:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813306.214119:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313378304 00000100:00100000:2.0:1788813306.214135:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313378304 00000100:00100000:2.0:1788813306.214187:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788813306.214196:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313378304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788813306.214223:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788813306.214266:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313378304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813306.214273:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788813306.214295:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813306.214331:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313378304:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788813306.277222:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813307.046791:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788813307.236247:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788813307.236273:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313378432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788813307.236342:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813307.236455:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313378432 00000100:00100000:0.0:1788813307.236464:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313378432 00000100:00100000:0.0:1788813307.236524:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788813307.236532:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313378432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813307.236567:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788813307.236633:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313378432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813307.236639:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788813307.237201:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813307.237214:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313378560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788813307.237250:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813307.237328:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313378560 00000100:00100000:2.0:1788813307.237334:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313378560 00000100:00100000:2.0:1788813307.237370:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788813307.237379:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313378560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788813307.237400:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788813307.237447:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875706313378560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813307.237453:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788813307.237574:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1875706313378560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813307.237793:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313378432:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788813307.300194:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813308.077549:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813308.078094:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301773440 00000100:00100000:1.0:1788813308.078106:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301773440 00000100:00100000:1.0:1788813308.078204:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:1.0:1788813308.078222:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:15553:x1875706301773440:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813308.078245:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813308.078269:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8c00/0xf32533d6ff7040d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729b7b expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.078351:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff7040df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.078377:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff7040df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.078390:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff7040df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.078407:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff7040e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.078415:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff7040e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.078421:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff7040e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.078518:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9e00/0xf32533d6ff7040ed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.078527:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9e00/0xf32533d6ff7040ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.078550:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9e00/0xf32533d6ff7040ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813308.078594:0:17161:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788813308.078599:0:17161:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788813308.078641:0:17161:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9e00/0xf32533d6ff7040ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.078651:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff7040df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.078657:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff7040df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.078663:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff7040df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.078668:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813308.078672:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff7040df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788813308.078889:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788813308.078962:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff7040df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.078976:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe40a00) 00010000:00010000:1.0:1788813308.078980:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813308.078986:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff7040df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.078993:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff7040df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.079018:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff7040e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.079024:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff7040e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.079031:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff7040e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.079036:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813308.079039:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff7040e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.079044:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff7040e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.079053:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff948a455ee000) 00010000:00010000:1.0:1788813308.079055:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813308.079058:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff7040e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.079063:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff7040e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.079096:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8c00/0xf32533d6ff7040d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b7b expref: 8 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.079110:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9e00/0xf32533d6ff7040ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b7b expref: 7 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.079128:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff948a455eed00) 00010000:00010000:1.0:1788813308.079131:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813308.079133:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9e00, rc 0) 00000100:00100000:1.0:1788813308.080924:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:15553:x1875706301773440:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 2693us (3414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813308.080955:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:3.0:1788813308.097043:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813308.097204:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301773568 00000100:00100000:1.0:1788813308.097220:0:17173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301773568 00000100:00100000:1.0:1788813308.097337:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:1.0:1788813308.097353:0:17173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:15553:x1875706301773568:12345-192.168.202.13@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788813308.097482:0:17173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:15553:x1875706301773568:12345-192.168.202.13@tcp:900:lhsmtool_posix.0 Request processed in 133us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813308.097491:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:3.0:1788813308.104371:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813308.104556:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301773824 00000100:00100000:1.0:1788813308.104571:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301773824 00000100:00100000:0.0:1788813308.113626:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:0.0:1788813308.113652:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:15553:x1875706301773824:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813308.113691:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813308.113730:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7040f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729b82 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.113824:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff7040fb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.113839:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff7040fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.113851:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff7040fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.113878:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704102 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.113886:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704102 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.113907:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704102 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114103:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff704109 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114113:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff704109 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114119:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff704109 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813308.114129:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788813308.114278:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff7040fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114286:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff7040fb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114293:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff7040fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114298:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813308.114303:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff7040fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114309:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff7040fb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114321:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff948a455eed00) 00010000:00010000:0.0:1788813308.114325:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813308.114336:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff7040fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114343:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff7040fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114357:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704102 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114363:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704102 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114369:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704102 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114374:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813308.114377:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704102 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114383:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704102 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114389:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff948a6aed9700) 00010000:00010000:0.0:1788813308.114392:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813308.114394:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704102 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.114400:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704102 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.116161:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7040f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b82 expref: 10 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.116201:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda000/0xf32533d6ff704109 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b82 expref: 9 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.116210:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6aed9800) 00010000:00010000:0.0:1788813308.116213:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813308.116216:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cda000, rc 0) 00000100:00100000:0.0:1788813308.116371:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+9:15553:x1875706301773824:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 2722us (12014us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788813308.116381:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:0.0:1788813308.128077:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813308.128558:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301773952 00000100:00100000:2.0:1788813308.128586:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301773952 00000100:00100000:2.0:1788813308.132267:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:2.0:1788813308.132290:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+9:15553:x1875706301773952:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788813308.132436:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+9:15553:x1875706301773952:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 Request processed in 155us (4367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813308.132462:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:3.0:1788813308.135508:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813308.136333:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301774080 00000100:00100000:0.0:1788813308.136350:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301774080 00000100:00100000:0.0:1788813308.137229:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 26 00000100:00100000:0.0:1788813308.137247:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:15553:x1875706301774080:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788813308.137617:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788813308.147258:0:18693:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 9963us 00000100:00100000:3.0:1788813308.176269:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813308.176434:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301774208 00000100:00100000:1.0:1788813308.176449:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301774208 00000100:00100000:1.0:1788813308.176531:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 27 00000100:00100000:1.0:1788813308.176549:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+9:15559:x1875706301774208:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813308.176569:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813308.176597:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8c00/0xf32533d6ff704117 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729b89 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176671:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff70411e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176706:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff70411e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176718:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff70411e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176732:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704125 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176740:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704125 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176747:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704125 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176787:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff70411e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176794:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff70411e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176801:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff70411e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176806:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813308.176810:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff70411e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176816:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff70411e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176829:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe40a00) 00010000:00010000:1.0:1788813308.176839:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813308.176844:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff70411e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176850:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9000/0xf32533d6ff70411e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176862:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704125 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176868:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704125 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176873:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704125 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176877:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:1.0:1788813308.176880:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704125 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176885:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704125 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176891:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff948a455ee000) 00010000:00010000:1.0:1788813308.176893:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813308.176896:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704125 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176901:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9800/0xf32533d6ff704125 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176970:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8c00/0xf32533d6ff704117 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b89 expref: 10 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.176987:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe40a00) 00010000:00010000:1.0:1788813308.176990:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813308.176994:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f8c00/0xf32533d6ff704117 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b89 expref: 10 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.177003:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f8c00, rc 0) 00000100:00100000:1.0:1788813308.177064:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+9:15559:x1875706301774208:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 518us (805us total) trans 0 rc 301/301 00000100:00100000:1.0:1788813308.177072:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 27 00000100:00100000:0.0:1788813308.182376:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:15553:x1875706301774080:12345-192.168.202.13@tcp:59:lhsmtool_posix.0 Request processed in 45124us (46876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813308.182391:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 26 00000100:00100000:0.0:1788813308.184814:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813308.188310:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301774336 00000100:00100000:2.0:1788813308.188439:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301774336 00000100:00100000:2.0:1788813308.188554:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:2.0:1788813308.188565:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+9:15559:x1875706301774336:12345-192.168.202.13@tcp:700:lfs.0 00000100:00100000:2.0:1788813308.188674:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+9:15559:x1875706301774336:12345-192.168.202.13@tcp:700:lfs.0 Request processed in 111us (3871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813308.188682:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:1.0:1788813308.204538:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813308.204725:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301774592 00000100:00100000:3.0:1788813308.204739:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301774592 00000100:00100000:3.0:1788813308.204812:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:3.0:1788813308.204825:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+9:15559:x1875706301774592:12345-192.168.202.13@tcp:36:lfs.0 00010000:00010000:3.0:1788813308.204884:0:17164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813308.204911:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704045 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729af6 expref: 9 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.204961:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe40a00) 00010000:00010000:3.0:1788813308.204983:0:17164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813308.205068:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70412c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.205081:0:17164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff704084 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b66 expref: 5 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.205090:0:17164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70412c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.205128:0:17164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff704084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b66 expref: 5 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.205143:0:17164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff704084 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b66 expref: 5 pid: 18693 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813308.205157:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944170380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17164:1875706313378688:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813308.205752:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a510f2840 going to sleep for 11 seconds 00000100:00100000:3.0:1788813308.214968:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944170380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17164:1875706313378688:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813308.215002:0:17164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70412c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813308.217695:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813308.217767:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301774720 00000100:00100000:2.0:1788813308.217780:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301774720 00010000:00010000:2.0:1788813308.217853:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff704084 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b66 expref: 6 pid: 18693 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813308.217896:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:2.0:1788813308.217907:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:342c3357-8551-4188-a7af-8af88d224192+6:2396:x1875706301774720:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813308.217922:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813308.217954:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff704084 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b66 expref: 6 pid: 18693 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.217971:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff704084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b66 expref: 6 pid: 18693 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.217998:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff704084 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b66 expref: 6 pid: 18693 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788813308.218168:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788813308.218203:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe40a00) 00010000:00010000:2.0:1788813308.218211:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70412c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.218221:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70412c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.218229:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70412c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.218259:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813308.218566:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:342c3357-8551-4188-a7af-8af88d224192+5:2396:x1875706301774720:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 659us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813308.218575:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15 00010000:00010000:3.0:1788813308.218726:0:17164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70412c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.218735:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70412c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.218763:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff704133 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.218786:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff704133 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.218795:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff704133 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.221719:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff70413a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.221745:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff70413a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.221757:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff70413a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813308.221775:0:17164:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022c000fe reply state 000000000878b172 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff70413a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.221786:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff70413a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.221792:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948a6fe50e00) 00010000:00010000:3.0:1788813308.221795:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788813308.221800:0:17164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788813308.221805:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788813308.221813:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70412c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.221819:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70412c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.221826:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70412c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.221840:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943656200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813308.221844:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70412c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.221852:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70412c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.221862:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe40a00) 00010000:00010000:3.0:1788813308.221865:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813308.221868:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70412c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.221874:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70412c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813308.221896:0:17164:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022c000fe reply state 000000000878b172 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff704133 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.221904:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff704133 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.221910:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff948a6fe50500) 00010000:00010000:3.0:1788813308.221912:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788813308.221915:0:17164:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788813308.222113:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+10:15559:x1875706301774592:12345-192.168.202.13@tcp:36:lfs.0 Request processed in 17285us (19082us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788813308.222122:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:1.0:1788813308.312504:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813308.312638:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301774848 00000100:00100000:3.0:1788813308.312650:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301774848 00000100:00100000:3.0:1788813308.312744:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00100000:3.0:1788813308.312768:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+10:15567:x1875706301774848:12345-192.168.202.13@tcp:101:lctl.0 00010000:00010000:3.0:1788813308.312791:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813308.312815:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff704141 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729b90 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.312881:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff704148 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.312895:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff704148 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.312908:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff704148 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813308.312993:0:17161:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788813308.312998:0:17161:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813308.313052:0:17161:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff704148 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.313078:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff704141 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b90 expref: 12 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.313097:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030400/0xf32533d6ff704148 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b90 expref: 11 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.313106:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe50d00) 00010000:00010000:3.0:1788813308.313109:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813308.313113:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a40030400, rc 0) 00000100:00100000:3.0:1788813308.313181:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+11:15567:x1875706301774848:12345-192.168.202.13@tcp:101:lctl.0 Request processed in 414us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813308.313198:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 29 00010000:00010000:0.0:1788813308.324246:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813308.342195:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813308.342355:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301774976 00000100:00100000:2.0:1788813308.342369:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301774976 00000100:00100000:2.0:1788813308.342464:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:2.0:1788813308.342478:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342c3357-8551-4188-a7af-8af88d224192+5:15568:x1875706301774976:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813308.342508:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813308.342536:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70414f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729b97 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.342645:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff704156 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.342663:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff704156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.342677:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff704156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813308.344412:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788813308.344424:0:17163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788813308.344471:0:17163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff704156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.344518:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70414f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b97 expref: 7 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.344545:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09200/0xf32533d6ff704156 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b97 expref: 6 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.344554:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe50d00) 00010000:00010000:2.0:1788813308.344557:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813308.344561:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09200, rc 0) 00000100:00100000:2.0:1788813308.345301:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342c3357-8551-4188-a7af-8af88d224192+6:15568:x1875706301774976:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 2705us (3000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813308.345312:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:1.0:1788813308.349838:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813308.350022:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301775104 00000100:00100000:3.0:1788813308.350056:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301775104 00000100:00100000:2.0:1788813308.350373:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:2.0:1788813308.350391:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342c3357-8551-4188-a7af-8af88d224192+6:15568:x1875706301775104:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813308.350423:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813308.350446:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70415d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729b9e expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.351926:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704164 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.354588:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704164 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.354633:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704164 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.354657:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70416b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.354666:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70416b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.354673:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70416b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.354772:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704172 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.354782:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704172 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.354789:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704172 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813308.354844:0:17161:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788813308.354848:0:17161:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788813308.354872:0:17161:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704172 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.354885:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704164 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.354890:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704164 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.354902:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704164 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.354906:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813308.354909:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704164 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.354914:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704164 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.354924:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe50d00) 00010000:00010000:2.0:1788813308.354926:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813308.354947:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704164 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.356125:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704164 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.356158:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70416b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.356165:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70416b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.356172:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70416b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.356317:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813308.356322:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70416b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.356346:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70416b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.356359:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff948a6fe50500) 00010000:00010000:2.0:1788813308.356362:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813308.356367:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70416b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.356372:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70416b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.356428:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff70415d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b9e expref: 8 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.356444:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704172 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b9e expref: 7 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.356451:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948a6fe50e00) 00010000:00010000:2.0:1788813308.356454:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813308.356456:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09800, rc 0) 00000100:00100000:2.0:1788813308.357714:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342c3357-8551-4188-a7af-8af88d224192+7:15568:x1875706301775104:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 6794us (7352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813308.357725:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 31 00000100:00100000:3.0:1788813308.361230:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813308.361449:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301775232 00000100:00100000:1.0:1788813308.361465:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301775232 00000100:00100000:1.0:1788813308.361604:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00100000:1.0:1788813308.361615:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:342c3357-8551-4188-a7af-8af88d224192+5:15568:x1875706301775232:12345-192.168.202.13@tcp:900:lfs.0 00000100:00100000:1.0:1788813308.361714:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:342c3357-8551-4188-a7af-8af88d224192+5:15568:x1875706301775232:12345-192.168.202.13@tcp:900:lfs.0 Request processed in 101us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813308.361723:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00080000:0.0:1788813308.361792:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788813308.370248:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813308.370526:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301775488 00000100:00100000:0.0:1788813308.370539:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301775488 00000100:00100000:0.0:1788813308.370619:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 32 00000100:00100000:0.0:1788813308.370630:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342c3357-8551-4188-a7af-8af88d224192+7:15568:x1875706301775488:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813308.370669:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813308.370691:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb200/0xf32533d6ff704179 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729ba5 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813308.370825:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788813308.370963:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb200/0xf32533d6ff704179 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ba5 expref: 9 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.370978:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe50d00) 00010000:00010000:0.0:1788813308.370982:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788813308.370987:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb200/0xf32533d6ff704179 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729ba5 expref: 9 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.371004:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdb200, rc 0) 00000100:00100000:0.0:1788813308.371082:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342c3357-8551-4188-a7af-8af88d224192+8:15568:x1875706301775488:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 453us (844us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788813308.371090:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 32 00000100:00100000:1.0:1788813308.381832:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813308.381978:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301775744 00000100:00100000:0.0:1788813308.381988:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301775744 00000100:00100000:0.0:1788813308.382052:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 33 00000100:00100000:0.0:1788813308.382063:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342c3357-8551-4188-a7af-8af88d224192+8:15568:x1875706301775744:12345-192.168.202.13@tcp:36:lfs.0 00010000:00010000:0.0:1788813308.382119:0:18693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813308.382148:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff704172 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729b9e expref: 8 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.382169:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948a6fe50e00) 00010000:00010000:0.0:1788813308.382175:0:18693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813308.382212:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb200/0xf32533d6ff704187 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.382226:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb200/0xf32533d6ff704187 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.382236:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb200/0xf32533d6ff704187 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813308.382424:0:18693:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000955160d5 reply state 00000000a54817ec transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb200/0xf32533d6ff704187 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.382438:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb200/0xf32533d6ff704187 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.382444:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948a6fe50e00) 00010000:00010000:0.0:1788813308.382446:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788813308.382449:0:18693:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788813308.382456:0:18693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788813308.382553:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342c3357-8551-4188-a7af-8af88d224192+9:15568:x1875706301775744:12345-192.168.202.13@tcp:36:lfs.0 Request processed in 479us (717us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788813308.382560:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 33 00000100:00100000:3.0:1788813308.384563:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813308.384695:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301776000 00000100:00100000:0.0:1788813308.384705:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301776000 00000100:00100000:0.0:1788813308.384761:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2 00000100:00100000:0.0:1788813308.384771:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342c3357-8551-4188-a7af-8af88d224192+9:15568:x1875706301776000:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:0.0:1788813308.384998:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342c3357-8551-4188-a7af-8af88d224192+10:15568:x1875706301776000:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 227us (441us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788813308.385006:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2 00000100:00100000:3.0:1788813308.388482:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813308.388557:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301776256 00000100:00100000:0.0:1788813308.388595:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301776256 00000100:00100000:0.0:1788813308.388700:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 34 00000100:00100000:0.0:1788813308.388712:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342c3357-8551-4188-a7af-8af88d224192+10:15568:x1875706301776256:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813308.388736:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813308.388756:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70418e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729bac expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.388830:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704195 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.388845:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.388856:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.388868:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff70419c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.388875:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff70419c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.388880:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff70419c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813308.389021:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788813308.389090:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389097:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704195 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389114:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704195 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389120:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb400 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813308.389125:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704195 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389133:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704195 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389145:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe50d00) 00010000:00010000:0.0:1788813308.389148:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813308.389153:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704195 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389159:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb400/0xf32533d6ff704195 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389172:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff70419c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389178:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff70419c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389183:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff70419c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389187:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cda800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813308.389190:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff70419c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389204:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff70419c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389213:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff948a6fe50500) 00010000:00010000:0.0:1788813308.389215:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813308.389218:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff70419c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389224:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cda800/0xf32533d6ff70419c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389257:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70418e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bac expref: 12 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389268:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe50d00) 00010000:00010000:0.0:1788813308.389270:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788813308.389273:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdbc00/0xf32533d6ff70418e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bac expref: 12 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.389282:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a44cdbc00, rc 0) 00000100:00100000:0.0:1788813308.389348:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342c3357-8551-4188-a7af-8af88d224192+11:15568:x1875706301776256:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 639us (874us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788813308.389356:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 34 00000100:00100000:1.0:1788813308.395655:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813308.395736:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301776384 00000100:00100000:0.0:1788813308.395747:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301776384 00000100:00100000:0.0:1788813308.395807:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 35 00000100:00100000:0.0:1788813308.395818:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342c3357-8551-4188-a7af-8af88d224192+11:15568:x1875706301776384:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813308.395858:0:18693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813308.395880:0:18693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7041aa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729bb3 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.396010:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166e800/0xf32533d6ff7041b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.396027:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166e800/0xf32533d6ff7041b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.396041:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166e800/0xf32533d6ff7041b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813308.396069:0:18693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788813308.396072:0:18693:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813308.396091:0:18693:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166e800/0xf32533d6ff7041b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.396120:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdaa00/0xf32533d6ff7041aa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bb3 expref: 13 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.396138:0:18693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166e800/0xf32533d6ff7041b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bb3 expref: 12 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.396146:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948a6fe50e00) 00010000:00010000:0.0:1788813308.396149:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813308.396152:0:18693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166e800, rc 0) 00000100:00100000:0.0:1788813308.396213:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342c3357-8551-4188-a7af-8af88d224192+12:15568:x1875706301776384:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 397us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813308.396221:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 35 00000100:00100000:3.0:1788813308.399787:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813308.402857:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301776512 00000100:00100000:0.0:1788813308.402876:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301776512 00000100:00100000:0.0:1788813308.402966:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:0.0:1788813308.402977:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342c3357-8551-4188-a7af-8af88d224192+12:15568:x1875706301776512:12345-192.168.202.13@tcp:37:lfs.0 00000100:00100000:0.0:1788813308.408488:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342c3357-8551-4188-a7af-8af88d224192+12:15568:x1875706301776512:12345-192.168.202.13@tcp:37:lfs.0 Request processed in 5501us (8706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813308.408503:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:1.0:1788813308.411891:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813308.412030:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301776768 00000100:00100000:2.0:1788813308.412041:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301776768 00000100:00100000:2.0:1788813308.412098:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4 00000100:00100000:2.0:1788813308.412109:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a639a3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:342c3357-8551-4188-a7af-8af88d224192+12:15568:x1875706301776768:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813308.412354:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a639a3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:342c3357-8551-4188-a7af-8af88d224192+13:15568:x1875706301776768:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 247us (472us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788813308.412361:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4 00000100:00100000:3.0:1788813308.478306:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813308.478443:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301776896 00000100:00100000:2.0:1788813308.478461:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301776896 00000100:00100000:2.0:1788813308.478610:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 36 00000100:00100000:2.0:1788813308.478622:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+11:15574:x1875706301776896:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:2.0:1788813308.478642:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813308.478676:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7041b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729bba expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.478747:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7041bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.478763:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7041bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.478776:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7041bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.478788:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff7041c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.478797:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff7041c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.478805:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff7041c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.478883:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff7041cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.478906:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff7041cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.478914:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff7041cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813308.478996:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788813308.479001:0:17163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788813308.479041:0:17163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff7041cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479054:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7041bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479061:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7041bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479068:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7041bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479075:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813308.479079:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7041bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479087:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7041bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479100:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe50d00) 00010000:00010000:2.0:1788813308.479103:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813308.479109:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7041bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479126:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7041bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479142:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff7041c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479149:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff7041c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479155:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff7041c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479160:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813308.479163:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff7041c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479170:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff7041c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479178:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff948a6fe50500) 00010000:00010000:2.0:1788813308.479180:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813308.479184:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff7041c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479190:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff7041c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479235:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7041b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bba expref: 13 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479264:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09800/0xf32533d6ff7041cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bba expref: 12 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.479271:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948a6fe50e00) 00010000:00010000:2.0:1788813308.479274:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788813308.479277:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09800, rc 0) 00000100:00100000:2.0:1788813308.479340:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+12:15574:x1875706301776896:12345-192.168.202.13@tcp:101:bash.0 Request processed in 721us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813308.479348:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 36 00000100:00100000:3.0:1788813308.482261:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813308.482479:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301777024 00000100:00100000:1.0:1788813308.482495:0:17174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301777024 00000100:00100000:1.0:1788813308.482624:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:1.0:1788813308.482637:0:17174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:15574:x1875706301777024:12345-192.168.202.13@tcp:900:bash.0 00000100:00100000:1.0:1788813308.482751:0:17174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:15574:x1875706301777024:12345-192.168.202.13@tcp:900:bash.0 Request processed in 115us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813308.482759:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:1.0:1788813308.485638:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813308.486856:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301777280 00000100:00100000:0.0:1788813308.486874:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301777280 00000100:00100000:0.0:1788813308.486991:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 37 00000100:00100000:0.0:1788813308.487004:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+12:15574:x1875706301777280:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813308.487030:0:18693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813308.487130:0:18693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff7041d4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729bc1 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.487472:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff7041db lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.487493:0:18693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166e800/0xf32533d6ff7041b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bb3 expref: 12 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.487503:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff7041db lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.487567:0:18693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166e800/0xf32533d6ff7041b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bb3 expref: 12 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813308.487601:0:18693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166e800/0xf32533d6ff7041b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bb3 expref: 12 pid: 18693 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813308.487622:0:18693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948942e05500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18693:1875706313378816:192.168.202.13@tcp:104: 00000100:00100000:1.0:1788813308.487746:0:18693:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894229a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813308.491015:0:18693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948942e05500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18693:1875706313378816:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813308.491061:0:18693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff7041db lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813308.493005:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813308.493331:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301777408 00000100:00100000:3.0:1788813308.493345:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301777408 00010000:00010000:3.0:1788813308.493403:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166e800/0xf32533d6ff7041b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bb3 expref: 13 pid: 18693 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813308.493453:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 16 00000100:00100000:3.0:1788813308.493465:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:342c3357-8551-4188-a7af-8af88d224192+13:2397:x1875706301777408:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813308.493484:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813308.493492:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166e800/0xf32533d6ff7041b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bb3 expref: 13 pid: 18693 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.493506:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166e800/0xf32533d6ff7041b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bb3 expref: 13 pid: 18693 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.493708:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166e800/0xf32533d6ff7041b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bb3 expref: 13 pid: 18693 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.493730:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948a6fe50e00) 00010000:00010000:3.0:1788813308.493736:0:17149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff7041db lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.493747:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff7041db lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.493755:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff7041db lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.493799:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813308.493876:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:342c3357-8551-4188-a7af-8af88d224192+12:2397:x1875706301777408:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 412us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813308.493886:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 16 00010000:00010000:0.0:1788813308.493893:0:18693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff7041db lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.493913:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff7041db lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.493988:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fa00/0xf32533d6ff7041e2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.494002:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fa00/0xf32533d6ff7041e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.494015:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fa00/0xf32533d6ff7041e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.494495:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff7041e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.494520:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff7041e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.494527:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff7041e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813308.494539:0:18693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788813308.494564:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff7041db lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.494571:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff7041db lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.496807:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff7041db lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.496818:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a7b5f9600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813308.496824:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff7041db lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.496833:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff7041db lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.496854:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948a6fe50e00) 00010000:00010000:0.0:1788813308.496857:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813308.496863:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff7041db lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.496869:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9600/0xf32533d6ff7041db lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813308.496893:0:18693:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c1413ba reply state 000000006d5ea113 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fa00/0xf32533d6ff7041e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.496927:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fa00/0xf32533d6ff7041e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.496953:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff948a6aed9700) 00010000:00010000:0.0:1788813308.496955:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788813308.496959:0:18693:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788813308.497028:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff7041d4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bc1 expref: 15 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.497045:0:18693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff7041e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bc1 expref: 14 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.497053:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:0.0:1788813308.497055:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788813308.497057:0:18693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f000, rc 0) 00000100:00100000:0.0:1788813308.497137:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+15:15574:x1875706301777280:12345-192.168.202.13@tcp:101:bash.0 Request processed in 10135us (11511us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788813308.497146:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 37 00000100:00100000:1.0:1788813308.515702:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813308.515843:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301777536 00000100:00100000:0.0:1788813308.515854:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301777536 00000100:00100000:0.0:1788813308.516018:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 38 00000100:00100000:0.0:1788813308.516029:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+15:15574:x1875706301777536:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813308.516062:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813308.516083:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff7041f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729bc8 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.516150:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7041fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.516172:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7041fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.516185:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7041fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813308.516255:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788813308.516260:0:17164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788813308.516283:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7041fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.516294:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7041fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.516323:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff7041f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bc8 expref: 17 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.516344:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7041fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bc8 expref: 16 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813308.516352:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:0.0:1788813308.516356:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813308.516360:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166fc00, rc 0) 00000100:00100000:0.0:1788813308.516431:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+16:15574:x1875706301777536:12345-192.168.202.13@tcp:101:bash.0 Request processed in 403us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813308.516438:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 38 00000100:00100000:1.0:1788813308.520379:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813308.520550:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301777792 00000100:00100000:2.0:1788813308.520568:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301777792 00000100:00100000:0.0:1788813308.520747:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:0.0:1788813308.520859:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+16:15574:x1875706301777792:12345-192.168.202.13@tcp:35:bash.0 00000100:00100000:1.0:1788813308.524539:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+17:15574:x1875706301777792:12345-192.168.202.13@tcp:35:bash.0 Request processed in 3670us (4159us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788813308.524552:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 5 00000100:00100000:3.0:1788813308.622314:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813308.622504:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301778048 00000100:00100000:2.0:1788813308.622520:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301778048 00000100:00100000:2.0:1788813308.622859:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 39 00000100:00100000:2.0:1788813308.622870:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+17:15584:x1875706301778048:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813308.622894:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813308.622914:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704205 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729bcf expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813308.623056:0:17161:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788813308.623155:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704205 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bcf expref: 19 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.623170:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe50d00) 00010000:00010000:2.0:1788813308.623173:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813308.623178:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704205 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bcf expref: 19 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.623207:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08c00, rc 0) 00000100:00100000:2.0:1788813308.623293:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+18:15584:x1875706301778048:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 423us (994us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788813308.623300:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 39 00000100:00100000:0.0:1788813308.627374:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813308.627484:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301778304 00000100:00100000:2.0:1788813308.627496:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301778304 00000100:00100000:2.0:1788813308.627626:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00100000:2.0:1788813308.627636:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+18:15584:x1875706301778304:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813308.627885:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+19:15584:x1875706301778304:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 248us (521us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788813308.627893:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 6 00000100:00100000:1.0:1788813308.683363:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813308.683623:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301778560 00000100:00100000:2.0:1788813308.683641:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301778560 00000100:00100000:2.0:1788813308.683915:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 40 00000100:00100000:2.0:1788813308.683927:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948942e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+19:15587:x1875706301778560:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813308.684003:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813308.684025:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704213 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729bd6 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.684159:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70421a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.684175:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70421a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.684187:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70421a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813308.684214:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788813308.684320:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704213 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bd6 expref: 22 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.684341:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70421a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bd6 expref: 21 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.684350:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:2.0:1788813308.684354:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813308.684357:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08e00, rc 0) 00000100:00100000:2.0:1788813308.684427:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948942e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+21:15587:x1875706301778560:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 503us (1709us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788813308.684435:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 40 00000100:00100000:3.0:1788813308.691438:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813308.691528:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301778688 00000100:00100000:2.0:1788813308.691540:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301778688 00000100:00100000:2.0:1788813308.691676:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 41 00000100:00100000:2.0:1788813308.691687:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+21:15587:x1875706301778688:12345-192.168.202.13@tcp:54:lfs.0 00010000:00010000:2.0:1788813308.691769:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704228 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.691786:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.691797:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.691832:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.691853:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704228 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.691860:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704228 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.691866:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813308.691871:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704228 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.691879:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704228 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.691891:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:2.0:1788813308.691895:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813308.691899:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704228 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813308.691905:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704228 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813308.692022:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+21:15587:x1875706301778688:12345-192.168.202.13@tcp:54:lfs.0 Request processed in 337us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813308.692040:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 41 00000100:00100000:3.0:1788813308.692371:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813308.692491:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301778816 00000100:00100000:3.0:1788813308.692501:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301778816 00000100:00100000:3.0:1788813308.692568:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:3.0:1788813308.692589:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+21:2396:x1875706301778816:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813308.692606:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813308.692632:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff70421a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bd6 expref: 21 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813308.692671:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:3.0:1788813308.692677:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813308.693369:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+20:2396:x1875706301778816:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 777us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813308.693380:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 0 00000040:00080000:1.0:1788813308.711561:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788813308.712689:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813308.712776:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301779072 00000100:00100000:2.0:1788813308.712791:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301779072 00000100:00100000:2.0:1788813308.712865:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:2.0:1788813308.712874:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+20:15587:x1875706301779072:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813308.713316:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+21:15587:x1875706301779072:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 441us (637us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788813308.713338:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 7 00000100:00100000:1.0:1788813308.805505:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813308.805582:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813308.805619:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813308.805652:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813308.805689:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301779456 00000100:00100000:1.0:1788813308.805701:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301779456 00000100:00100000:2.0:1788813308.805762:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301779200 00000100:00100000:2.0:1788813308.805769:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301779200 00000100:00100000:1.0:1788813308.805775:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301779712 00000100:00100000:1.0:1788813308.805778:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301779712 00000100:00100000:1.0:1788813308.805795:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301779328 00000100:00100000:1.0:1788813308.805798:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301779328 00000100:00100000:2.0:1788813308.805804:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 165 00000100:00100000:2.0:1788813308.805815:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:2398:x1875706301779200:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813308.805827:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:1.0:1788813308.805834:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2398:x1875706301779456:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813308.805919:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:3.0:1788813308.805965:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342c3357-8551-4188-a7af-8af88d224192+5:2398:x1875706301779712:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813308.806056:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2398:x1875706301779456:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 220us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813308.806063:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:1.0:1788813308.806086:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:1.0:1788813308.806092:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2398:x1875706301779328:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813308.807948:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:2398:x1875706301779200:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 2101us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813308.807967:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 165 00000100:00100000:1.0:1788813308.807995:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2398:x1875706301779328:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 1888us (2328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813308.808011:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813308.808022:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:2.0:1788813308.808052:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301779584 00000100:00100000:2.0:1788813308.808063:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301779584 00000100:00080000:1.0:1788813308.808074:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813308.808099:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813308.808129:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:2.0:1788813308.808139:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:342c3357-8551-4188-a7af-8af88d224192+5:2398:x1875706301779584:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813308.808182:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:342c3357-8551-4188-a7af-8af88d224192+5:2398:x1875706301779584:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 44us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813308.808189:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:2.0:1788813308.812345:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342c3357-8551-4188-a7af-8af88d224192+5:2398:x1875706301779712:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 6398us (6705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813308.812366:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:1.0:1788813309.077858:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813309.078655:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301779968 00000100:00100000:2.0:1788813309.078673:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301779968 00000100:00100000:2.0:1788813309.078828:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 42 00000100:00100000:2.0:1788813309.078844:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+21:15618:x1875706301779968:12345-192.168.202.13@tcp:101:cat.0 00010000:00010000:2.0:1788813309.078882:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813309.078913:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff70422f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729bdd expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.079137:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704236 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.079156:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.079174:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813309.079188:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788813309.079752:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff70422f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bdd expref: 24 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.079777:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704236 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bdd expref: 23 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.079787:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:2.0:1788813309.079790:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813309.079795:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08c00, rc 0) 00000100:00100000:2.0:1788813309.082150:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+23:15618:x1875706301779968:12345-192.168.202.13@tcp:101:cat.0 Request processed in 3290us (4288us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788813309.082168:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 42 00000040:00080000:1.0:1788813309.093897:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788813309.102479:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813309.102662:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813309.103797:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301780352 00000100:00100000:1.0:1788813309.103817:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301780352 00000100:00100000:1.0:1788813309.103980:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 1 00000100:00100000:1.0:1788813309.103995:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+23:2399:x1875706301780352:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813309.104016:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813309.104049:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704236 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bdd expref: 23 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813309.104076:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:1.0:1788813309.104084:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813309.104159:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+22:2399:x1875706301780352:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 169us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813309.104167:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 1 00000100:00100000:3.0:1788813309.107059:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301780224 00000100:00100000:3.0:1788813309.107082:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301780224 00000100:00100000:3.0:1788813309.107166:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:3.0:1788813309.107179:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+22:15618:x1875706301780224:12345-192.168.202.13@tcp:35:cat.0 00000100:00100000:3.0:1788813309.107823:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+23:15618:x1875706301780224:12345-192.168.202.13@tcp:35:cat.0 Request processed in 644us (5356us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788813309.107833:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 8 00000100:00100000:0.0:1788813309.221524:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813309.221822:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301780608 00000100:00100000:3.0:1788813309.221837:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301780608 00000100:00100000:3.0:1788813309.221922:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 43 00000100:00100000:3.0:1788813309.221984:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+23:15624:x1875706301780608:12345-192.168.202.13@tcp:101:dd.0 00010000:00010000:3.0:1788813309.222019:0:18693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813309.222062:0:18693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff704244 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729be4 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.222316:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70424b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.222914:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70424b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.222974:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70424b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813309.222992:0:18693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788813309.223187:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff704244 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729be4 expref: 26 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.223210:0:18693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70424b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729be4 expref: 25 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.223218:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:3.0:1788813309.223221:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813309.223225:0:18693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948943656200, rc 0) 00000100:00100000:3.0:1788813309.223313:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+25:15624:x1875706301780608:12345-192.168.202.13@tcp:101:dd.0 Request processed in 1380us (1804us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788813309.223321:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 43 00000100:00100000:1.0:1788813309.248140:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813309.248311:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813309.248485:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301780736 00000100:00100000:0.0:1788813309.248498:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301780736 00000100:00100000:0.0:1788813309.248598:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 44 00000100:00100000:0.0:1788813309.248612:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+25:15624:x1875706301780736:12345-192.168.202.13@tcp:101:dd.0 00010000:00010000:0.0:1788813309.248644:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813309.248671:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff704259 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729beb expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813309.248716:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff704260 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813309.248733:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff704260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813309.248747:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff704260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813309.248912:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff704259 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729beb expref: 27 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813309.248987:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff704260 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729beb expref: 26 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813309.249009:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:0.0:1788813309.249012:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788813309.249017:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166ec00, rc 0) 00000100:00100000:0.0:1788813309.249443:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+26:15624:x1875706301780736:12345-192.168.202.13@tcp:101:dd.0 Request processed in 832us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813309.249452:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 44 00000100:00100000:3.0:1788813309.252874:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301780864 00000100:00100000:3.0:1788813309.252895:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301780864 00000100:00100000:3.0:1788813309.253006:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2 00000100:00100000:3.0:1788813309.253017:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+26:2398:x1875706301780864:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813309.253046:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813309.253078:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70424b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729be4 expref: 26 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.253132:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:3.0:1788813309.253137:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813309.253806:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+25:2398:x1875706301780864:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 787us (5491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813309.253818:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2 00000100:00100000:0.0:1788813309.254139:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813309.254756:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301781120 00000100:00100000:3.0:1788813309.254767:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301781120 00000100:00100000:3.0:1788813309.254831:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 45 00000100:00100000:3.0:1788813309.254841:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+25:15624:x1875706301781120:12345-192.168.202.13@tcp:36:dd.0 00010000:00010000:3.0:1788813309.254911:0:18693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813309.254965:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff7041fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bc8 expref: 25 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.254987:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:3.0:1788813309.254992:0:18693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813309.255794:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704267 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.255817:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704267 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.255842:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704267 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813309.255905:0:18693:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788813309.256662:0:18693:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b752340 reply state 000000005c8a8acd transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704267 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.256705:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704267 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.256715:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:3.0:1788813309.256718:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788813309.256722:0:18693:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813309.256959:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+27:15624:x1875706301781120:12345-192.168.202.13@tcp:36:dd.0 Request processed in 2091us (2793us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788813309.256970:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 45 00000020:00080000:3.0:1788813309.256977:0:18693:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788813309.284247:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813309.284283:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313378944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813309.286642:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813309.286676:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313379072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813309.291912:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313379200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813309.292969:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813309.293115:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313379072 00000100:00100000:3.0:1788813309.293124:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313379072 00000100:00100000:3.0:1788813309.293186:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813309.293198:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313379072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813309.293231:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788813309.293297:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313379072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813309.293304:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813309.293358:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313379072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813309.293787:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813309.293813:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313378944 00000100:00100000:3.0:1788813309.293817:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313378944 00000100:00100000:3.0:1788813309.293862:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788813309.293870:0:18672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313378944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813309.294008:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788813309.295010:0:18672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313378944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1136us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813309.295031:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788813309.295328:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a76404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313378944:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788813309.295374:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813309.297230:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313379584:0@lo:400:kworker.0 00000100:00100000:0.0:1788813309.297332:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813309.297370:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313380096:0@lo:400:kworker.0 00000100:00100000:0.0:1788813309.297398:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813309.297444:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313380096 00000100:00100000:0.0:1788813309.297454:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313380096 00000100:00100000:0.0:1788813309.297519:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788813309.297541:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313380096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813309.297611:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875706313380096:12345-0@lo:400:kworker.0 Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813309.297618:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788813309.297672:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875706313380096:0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.297683:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313379328:0@lo:400:kworker.0 00000100:00100000:0.0:1788813309.297684:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313380608:0@lo:400:kworker.0 00000100:00100000:0.0:1788813309.297735:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813309.297789:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813309.297789:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788813309.297805:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313379456:0@lo:400:kworker.0 00000100:00100000:0.0:1788813309.297848:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313379328 00000100:00100000:3.0:1788813309.297876:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313379840:0@lo:400:kworker.0 00000100:00100000:0.0:1788813309.297876:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313379328 00000100:00100000:3.0:1788813309.297981:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813309.298002:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788813309.298013:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+24:3628:x1875706313379328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.298019:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313380352:0@lo:400:kworker.0 00000100:00100000:0.0:1788813309.298076:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7e65740-fccd-471b-95df-6f83776cc95f+24:3628:x1875706313379328:12345-0@lo:400:kworker.0 Request processed in 63us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813309.298090:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813309.298095:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788813309.298152:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313379328:0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.298169:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788813309.298176:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313379712:0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.298201:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813309.298221:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313380224:0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.298239:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813309.298275:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313380608 00000100:00100000:3.0:1788813309.298281:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313380608 00000100:00080000:3.0:1788813309.298309:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788813309.298341:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313380352 00000100:00100000:3.0:1788813309.298344:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313380352 00000100:00080000:3.0:1788813309.298356:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788813309.298366:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313379712 00000100:00100000:3.0:1788813309.298369:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313379712 00000100:00100000:3.0:1788813309.298379:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313380224 00000100:00100000:3.0:1788813309.298382:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313380224 00000100:00080000:3.0:1788813309.298393:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813309.298475:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788813309.298488:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313380608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.298552:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875706313380608:12345-0@lo:400:kworker.0 Request processed in 67us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813309.298560:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788813309.298589:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788813309.298596:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313380352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.298629:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875706313380352:12345-0@lo:400:kworker.0 Request processed in 34us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813309.298635:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1788813309.298662:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9489443b6300 x1875706313380352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813309.298674:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1875706313380352:0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.298702:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788813309.298708:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313379712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.298757:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313379712:12345-0@lo:400:kworker.0 Request processed in 49us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813309.298768:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788813309.298796:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313379712:0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.298811:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788813309.298818:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313380224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.298847:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313380224:12345-0@lo:400:kworker.0 Request processed in 30us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813309.298853:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788813309.298875:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313380224:0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.299045:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813309.299069:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313379968:0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.299094:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813309.299110:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313380480:0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.299134:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813309.299152:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313380480 00000100:00100000:3.0:1788813309.299156:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313380480 00000100:00080000:3.0:1788813309.299171:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813309.299191:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788813309.299197:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313380480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.299223:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313380480:12345-0@lo:400:kworker.0 Request processed in 27us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813309.299228:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788813309.299252:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313380480:0@lo:400:kworker.0 00010000:00080000:3.0:1788813309.299264:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948944024700 x1875706313380608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813309.299273:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1875706313380608:0@lo:400:kworker.0 00000100:00100000:1.0:1788813309.300233:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813309.300746:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313379840 00000100:00100000:3.0:1788813309.300756:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313379200 00000100:00100000:2.0:1788813309.300761:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313379840 00000100:00100000:3.0:1788813309.300770:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313379200 00000100:00100000:2.0:1788813309.300879:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313379456 00000100:00100000:2.0:1788813309.300886:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313379456 00000100:00100000:2.0:1788813309.300917:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788813309.300929:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313379840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.300982:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788813309.300995:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313379200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813309.301023:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1788813309.302824:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813309.302876:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788813309.302900:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313379456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.303132:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313379200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2139us (2904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813309.303139:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788813309.303191:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313379584 00000100:00100000:3.0:1788813309.303196:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313379584 00000100:00100000:3.0:1788813309.303220:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313379968 00000100:00100000:3.0:1788813309.303222:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313379968 00000100:00100000:3.0:1788813309.303243:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788813309.303247:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a44040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313379584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.303292:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a44040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313379584:12345-0@lo:400:kworker.0 Request processed in 44us (5961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813309.303298:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788813309.303435:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788813309.303442:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313379968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.303476:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313379968:12345-0@lo:400:kworker.0 Request processed in 36us (4382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813309.303488:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813309.303520:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313379840:12345-0@lo:400:kworker.0 Request processed in 2584us (5582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813309.303550:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313379968:0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.303583:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313379584:0@lo:400:kworker.0 00000100:00100000:3.0:1788813309.303650:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313379840:0@lo:400:kworker.0 00000100:00100000:1.0:1788813309.304383:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313379456:12345-0@lo:400:kworker.0 Request processed in 1495us (5337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813309.304391:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788813309.304424:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813309.304482:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313379200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813309.304724:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788813309.304764:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313379456:0@lo:400:kworker.0 00010000:00010000:3.0:1788813309.348301:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813309.356324:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813309.356411:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301781376 00000100:00100000:3.0:1788813309.356423:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301781376 00000100:00100000:3.0:1788813309.356484:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:3.0:1788813309.356493:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+27:15624:x1875706301781376:12345-192.168.202.13@tcp:35:dd.0 00000100:00100000:3.0:1788813309.356909:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+28:15624:x1875706301781376:12345-192.168.202.13@tcp:35:dd.0 Request processed in 416us (738us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1788813309.356981:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 9 00000100:00100000:1.0:1788813309.526915:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813309.534476:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301781504 00000100:00100000:3.0:1788813309.534500:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301781504 00000100:00100000:3.0:1788813309.534616:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00100000:3.0:1788813309.534631:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+28:15638:x1875706301781504:12345-192.168.202.13@tcp:101:stat.0 00010000:00010000:3.0:1788813309.534665:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813309.534696:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70426e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729bf2 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535073:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff704275 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535094:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff704275 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535109:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff704275 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535123:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70427c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535131:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70427c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535139:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70427c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535249:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff704283 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535282:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff704283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535289:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff704283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813309.535350:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788813309.535356:0:17164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813309.535422:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff704283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535438:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff704283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535448:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff704275 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535455:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff704275 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535463:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff704275 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535471:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40031200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813309.535477:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff704275 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535486:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff704275 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535501:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948a6fe50e00) 00010000:00010000:3.0:1788813309.535511:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813309.535518:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff704275 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535526:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40031200/0xf32533d6ff704275 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.535995:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70427c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.536001:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70427c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.536008:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70427c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.536013:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813309.536016:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70427c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.536023:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70427c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.536032:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff948a6aed9700) 00010000:00010000:3.0:1788813309.536035:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813309.536038:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70427c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.536044:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70427c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.536081:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943656200/0xf32533d6ff70426e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bf2 expref: 30 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.536116:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff704283 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bf2 expref: 29 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.536124:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:3.0:1788813309.536126:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813309.536129:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4e00, rc 0) 00000100:00100000:2.0:1788813309.543053:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+29:15638:x1875706301781504:12345-192.168.202.13@tcp:101:stat.0 Request processed in 8407us (16255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813309.543070:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 46 00000100:00100000:2.0:1788813309.631792:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813309.631990:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301781760 00000100:00100000:3.0:1788813309.632003:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301781760 00000100:00100000:3.0:1788813309.632080:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 47 00000100:00100000:3.0:1788813309.632093:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+29:15644:x1875706301781760:12345-192.168.202.13@tcp:36:truncate.0 00010000:00010000:3.0:1788813309.632174:0:17161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813309.632214:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff704283 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bf2 expref: 29 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.632272:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:3.0:1788813309.632285:0:17161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813309.632509:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70428a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.632549:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70428a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.632560:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70428a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813309.632635:0:17161:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1788813309.632671:0:17161:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a6e8c9e reply state 0000000021711ead transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70428a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.632700:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70428a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.632707:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:3.0:1788813309.632710:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788813309.632713:0:17161:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813309.632849:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+31:15644:x1875706301781760:12345-192.168.202.13@tcp:36:truncate.0 Request processed in 758us (1070us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788813309.632856:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 47 00000020:00080000:3.0:1788813309.632861:0:17161:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788813309.796408:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813309.796519:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301781888 00000100:00100000:3.0:1788813309.796538:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301781888 00000100:00100000:3.0:1788813309.796617:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 48 00000100:00100000:3.0:1788813309.796629:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+31:15658:x1875706301781888:12345-192.168.202.13@tcp:101:stat.0 00010000:00010000:3.0:1788813309.796664:0:18693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813309.796689:0:18693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff704291 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729bf9 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.796763:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff704298 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.796787:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff704298 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.796811:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff704298 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.796825:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff70429f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.796850:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff70429f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.796855:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff70429f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.796995:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797003:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797008:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813309.797060:0:18693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1788813309.797065:0:18693:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813309.797089:0:18693:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797103:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797112:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff704298 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797119:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff704298 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797126:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff704298 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797144:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813309.797149:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff704298 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797159:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff704298 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797173:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948a6fe50e00) 00010000:00010000:3.0:1788813309.797177:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813309.797184:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff704298 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797191:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff704298 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797209:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff70429f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797216:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff70429f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797222:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff70429f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797228:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813309.797230:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff70429f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797237:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff70429f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797256:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff948a6aed9700) 00010000:00010000:3.0:1788813309.797258:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813309.797260:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff70429f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797266:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff70429f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797300:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff704291 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bf9 expref: 33 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797317:0:18693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bf9 expref: 32 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.797323:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:3.0:1788813309.797325:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813309.797327:0:18693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4000, rc 0) 00000100:00100000:3.0:1788813309.797401:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+32:15658:x1875706301781888:12345-192.168.202.13@tcp:101:stat.0 Request processed in 776us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813309.797407:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 48 00000100:00100000:1.0:1788813309.880438:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813309.880524:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301782144 00000100:00100000:3.0:1788813309.880540:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301782144 00000100:00100000:3.0:1788813309.880640:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 49 00000100:00100000:3.0:1788813309.880653:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+32:15668:x1875706301782144:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813309.880681:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813309.880709:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c00 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813309.880879:0:17161:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788813309.881066:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c00 expref: 34 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.881083:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe50d00) 00010000:00010000:3.0:1788813309.881087:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813309.881093:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c00 expref: 34 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.881110:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4e00, rc 0) 00000100:00100000:3.0:1788813309.881395:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+33:15668:x1875706301782144:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 537us (761us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1788813309.881405:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 49 00000100:00100000:0.0:1788813309.885653:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813309.885722:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301782400 00000100:00100000:2.0:1788813309.886088:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301782400 00000100:00100000:2.0:1788813309.886169:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:2.0:1788813309.886182:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a453b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+33:15668:x1875706301782400:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813309.887653:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a453b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+34:15668:x1875706301782400:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 1462us (1999us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788813309.887667:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10 00000100:00100000:0.0:1788813309.953480:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813309.953607:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301782656 00000100:00100000:3.0:1788813309.953621:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301782656 00000100:00100000:3.0:1788813309.953764:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 50 00000100:00100000:3.0:1788813309.953777:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+34:15674:x1875706301782656:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:3.0:1788813309.953815:0:18693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813309.953857:0:18693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042bb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c07 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.954066:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.954085:0:18693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff7041e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bc1 expref: 35 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.954118:0:18693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bf9 expref: 35 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.954129:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.954174:0:18693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bf9 expref: 35 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.954192:0:18693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bf9 expref: 35 pid: 18693 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813309.954209:0:18693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18693:1875706313380736:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813309.954656:0:18693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff7041e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bc1 expref: 35 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.954666:0:18693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff7041e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bc1 expref: 35 pid: 18693 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813309.954675:0:18693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18693:1875706313380864:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813309.954701:0:18693:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894238c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788813309.958819:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813309.958956:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813309.960435:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301782784 00000100:00100000:2.0:1788813309.960465:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301782784 00010000:00010000:2.0:1788813309.960545:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042a6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bf9 expref: 36 pid: 18693 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813309.960606:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301782912 00000100:00100000:2.0:1788813309.960631:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301782912 00010000:00010000:2.0:1788813309.960647:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff7041e9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bc1 expref: 37 pid: 18693 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813309.960666:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 17 00000100:00100000:2.0:1788813309.960677:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a7ca6f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+37:2397:x1875706301782784:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813309.960698:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813309.960706:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042a6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bf9 expref: 37 pid: 18693 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.960722:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bf9 expref: 37 pid: 18693 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.960752:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:2.0:1788813309.960759:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.960770:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.960777:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813309.961249:0:17147:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788813309.961274:0:17147:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788813309.961509:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:1.0:1788813309.961532:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+37:2397:x1875706301782912:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813309.961544:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813309.961581:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff7041e9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bc1 expref: 37 pid: 18693 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813309.961594:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff7041e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bc1 expref: 37 pid: 18693 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813309.961610:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:1.0:1788813309.961616:0:17147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813309.961626:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813309.961635:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813309.961654:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813309.963087:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a7ca6f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+37:2397:x1875706301782784:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 2396us (4270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813309.963102:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 17 00010000:00010000:3.0:1788813309.963918:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bf9 expref: 36 pid: 18693 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813309.963963:0:18693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18693:1875706313380736:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813309.964007:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f000/0xf32533d6ff7041e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729bc1 expref: 35 pid: 18693 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813309.964019:0:18693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18693:1875706313380864:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813309.964159:0:18693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.964171:0:18693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.964177:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813309.964206:0:18693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1788813309.964413:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042bb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c07 expref: 36 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.964432:0:18693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c07 expref: 35 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.964621:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:3.0:1788813309.964626:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788813309.964631:0:18693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e5e00, rc 0) 00000100:00100000:1.0:1788813309.964848:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+35:2397:x1875706301782912:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 3315us (5877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813309.964875:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 18 00000100:00100000:3.0:1788813309.967590:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+34:15674:x1875706301782656:12345-192.168.202.13@tcp:101:bash.0 Request processed in 13789us (14099us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1788813309.967605:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 50 00000100:00100000:1.0:1788813309.971148:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813309.971360:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301783168 00000100:00100000:2.0:1788813309.971374:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301783168 00000100:00100000:2.0:1788813309.971573:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 51 00000100:00100000:2.0:1788813309.971590:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+34:15674:x1875706301783168:12345-192.168.202.13@tcp:36:bash.0 00010000:00010000:2.0:1788813309.972123:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7042d0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.972148:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7042d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.972161:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7042d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813309.972217:0:17163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788813309.972241:0:17163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005807902b reply state 000000001d782ded transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7042d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.972256:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7042d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.972342:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:2.0:1788813309.972345:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788813309.972351:0:17163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813309.972618:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+37:15674:x1875706301783168:12345-192.168.202.13@tcp:36:bash.0 Request processed in 1032us (1485us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788813309.972627:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 51 00000020:00080000:2.0:1788813309.972633:0:17163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788813309.976020:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813309.976144:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301783296 00000100:00100000:2.0:1788813309.976160:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301783296 00000100:00100000:2.0:1788813309.976283:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 52 00000100:00100000:2.0:1788813309.976296:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+37:15674:x1875706301783296:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:2.0:1788813309.976332:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813309.976361:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff7042d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c0e expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.976648:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff7042d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c0e expref: 38 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.976668:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff7042d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c0e expref: 38 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813309.976693:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:2.0:1788813309.976697:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813309.976701:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08000, rc 0) 00000100:00100000:2.0:1788813309.976855:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+38:15674:x1875706301783296:12345-192.168.202.13@tcp:101:bash.0 Request processed in 561us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813309.976864:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 52 00000100:00100000:0.0:1788813309.984385:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813309.984664:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301783424 00000100:00100000:3.0:1788813309.984678:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301783424 00000100:00100000:3.0:1788813309.984784:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 53 00000100:00100000:3.0:1788813309.984797:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+38:15674:x1875706301783424:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:3.0:1788813309.984826:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813309.984866:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c15 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.985110:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.985129:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c07 expref: 39 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.985138:0:17161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042e5 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.985180:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c07 expref: 39 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.985195:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c07 expref: 39 pid: 18693 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813309.985212:0:17161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17161:1875706313380992:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813309.985330:0:17161:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894238ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813309.995211:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813309.995643:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301783552 00000100:00100000:0.0:1788813309.995657:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301783552 00010000:00010000:0.0:1788813309.995714:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c07 expref: 40 pid: 18693 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813309.995769:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 19 00000100:00100000:0.0:1788813309.995781:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+40:2396:x1875706301783552:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813309.995799:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813309.995808:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c07 expref: 40 pid: 18693 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813309.995825:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c07 expref: 40 pid: 18693 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813309.995866:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:0.0:1788813309.995894:0:17149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813309.995907:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813309.995916:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042e5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813309.995974:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813309.996063:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+40:2396:x1875706301783552:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 284us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813309.996071:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 19 00010000:00010000:3.0:1788813309.998195:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042c2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c07 expref: 39 pid: 18693 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813309.998225:0:17161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17161:1875706313380992:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813309.998271:0:17161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.998307:0:17161:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.998315:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813309.998391:0:17161:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788813309.998396:0:17161:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813309.998424:0:17161:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.998483:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c15 expref: 39 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.998502:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c15 expref: 38 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813309.998512:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:3.0:1788813309.998516:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813309.998520:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4000, rc 0) 00000100:00100000:3.0:1788813309.998618:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+38:15674:x1875706301783424:12345-192.168.202.13@tcp:101:bash.0 Request processed in 13823us (14247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813309.998628:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 53 00000100:00100000:0.0:1788813310.002772:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813310.002979:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301783808 00000100:00100000:2.0:1788813310.002993:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301783808 00000100:00100000:2.0:1788813310.003099:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00100000:2.0:1788813310.003112:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+38:15674:x1875706301783808:12345-192.168.202.13@tcp:103:bash.0 00010000:00010000:2.0:1788813310.003134:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788813310.003167:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff7042d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c0e expref: 38 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.003196:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4000/0xf32533d6ff7042e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c15 expref: 37 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.003211:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:2.0:1788813310.003218:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813310.003316:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+36:15674:x1875706301783808:12345-192.168.202.13@tcp:103:bash.0 Request processed in 206us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813310.003323:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3 00000100:00080000:0.0:1788813310.004499:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813310.006207:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813310.006549:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301783936 00000100:00100000:3.0:1788813310.006570:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301783936 00000100:00100000:3.0:1788813310.006651:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 54 00000100:00100000:3.0:1788813310.006663:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+36:15674:x1875706301783936:12345-192.168.202.13@tcp:58:bash.0 00010000:00010000:3.0:1788813310.006852:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff7042ec lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.006886:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff7042ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.006901:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff7042ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813310.016979:0:18693:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813310.017332:0:18693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788813310.017460:0:18693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788813310.018069:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+36:15674:x1875706301783936:12345-192.168.202.13@tcp:58:bash.0 Request processed in 11401us (11866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813310.018081:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 54 00000100:00100000:2.0:1788813310.032145:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813310.032287:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301784064 00000100:00100000:3.0:1788813310.032298:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301784064 00000100:00100000:3.0:1788813310.032392:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 55 00000100:00100000:3.0:1788813310.032403:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+36:15674:x1875706301784064:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:3.0:1788813310.032424:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813310.032444:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c1c expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.032501:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff7042ec lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.032512:0:17163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042f3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c1c expref: 37 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.032544:0:17163:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff7042ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.032557:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042f3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c1c expref: 37 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.032583:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:3.0:1788813310.032586:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813310.032605:0:17163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042f3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c1c expref: 37 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.032613:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4e00, rc 0) 00000100:00100000:3.0:1788813310.032674:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+37:15674:x1875706301784064:12345-192.168.202.13@tcp:101:bash.0 Request processed in 273us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813310.032681:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 55 00010000:00010000:1.0:1788813310.373829:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813310.757887:0:17196:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788813310.757898:0:17196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813310.757969:0:17196:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788813310.757979:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788813310.758121:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17196:1875706313381120:192.168.202.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788813310.758223:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894229ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813310.775788:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17196:1875706313381120:192.168.202.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788813310.779177:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813310.779746:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301784192 00000100:00100000:2.0:1788813310.779758:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301784192 00000100:00100000:2.0:1788813310.779822:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 56 00000100:00100000:2.0:1788813310.779833:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+37:15675:x1875706301784192:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788813310.779866:0:17164:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788813310.780021:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+37:15675:x1875706301784192:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 Request processed in 190us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813310.780029:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 56 00000100:00100000:2.0:1788813310.797775:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813310.802141:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301784320 00000100:00100000:3.0:1788813310.802160:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301784320 00000100:00100000:3.0:1788813310.802262:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 57 00000100:00100000:3.0:1788813310.802274:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a764ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+37:15675:x1875706301784320:12345-192.168.202.13@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788813310.802348:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042fa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802365:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802377:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802427:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff704301 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802434:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff704301 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802441:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff704301 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802462:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff704308 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802484:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff704308 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802491:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff704308 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813310.802538:0:17161:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788813310.802543:0:17161:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788813310.802569:0:17161:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff704308 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802581:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802588:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042fa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802594:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802601:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813310.802606:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802613:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042fa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802624:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6aed9800) 00010000:00010000:3.0:1788813310.802627:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813310.802632:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802649:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff7042fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802664:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff704301 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802669:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff704301 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802674:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff704301 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802679:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813310.802682:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff704301 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802687:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff704301 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802705:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff948a6fe50f00) 00010000:00010000:3.0:1788813310.802708:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813310.802711:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff704301 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802716:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4200/0xf32533d6ff704301 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802734:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff704308 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802741:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff704308 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802752:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff704308 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802756:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813310.802759:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff704308 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802765:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff704308 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802771:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:3.0:1788813310.802773:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813310.802776:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff704308 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.802781:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff704308 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813310.802881:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a764ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+37:15675:x1875706301784320:12345-192.168.202.13@tcp:34:lhsmtool_posix.0 Request processed in 609us (5115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813310.802889:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 57 00000100:00100000:1.0:1788813310.812737:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813310.812871:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301784576 00000100:00100000:2.0:1788813310.812885:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301784576 00000100:00100000:2.0:1788813310.812992:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 58 00000100:00100000:2.0:1788813310.813003:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+37:15675:x1875706301784576:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813310.813026:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813310.813049:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff70430f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c23 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.813179:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704316 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.813196:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704316 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.813209:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704316 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813310.813234:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788813310.813314:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704316 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.813322:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704316 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.813329:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704316 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.813335:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813310.813339:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704316 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.813347:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704316 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.813359:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:2.0:1788813310.813363:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813310.813368:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704316 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.813373:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704316 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.813418:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff70430f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c23 expref: 39 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.813428:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948a6aed9800) 00010000:00010000:2.0:1788813310.813431:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813310.813441:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff70430f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c23 expref: 39 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.813452:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08000, rc 0) 00000100:00100000:2.0:1788813310.813521:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+38:15675:x1875706301784576:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 520us (795us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1788813310.813529:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 58 00000100:00100000:0.0:1788813310.820331:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813310.828224:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301784704 00000100:00100000:3.0:1788813310.828242:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301784704 00000100:00100000:2.0:1788813310.828433:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 59 00000100:00100000:2.0:1788813310.828445:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+38:15675:x1875706301784704:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788813310.828482:0:17161:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788813310.829965:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+38:15675:x1875706301784704:12345-192.168.202.13@tcp:53:lhsmtool_posix.0 Request processed in 1485us (9608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813310.829978:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 59 00000100:00100000:3.0:1788813310.846050:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813310.846178:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301784960 00000100:00100000:2.0:1788813310.846190:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301784960 00000100:00100000:2.0:1788813310.846318:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 60 00000100:00100000:2.0:1788813310.846330:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+38:15675:x1875706301784960:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813310.846358:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813310.846382:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704324 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c2a expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788813310.847066:0:17164:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:2.0:1788813310.847074:0:17164:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788813310.847094:0:17164:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788813310.847242:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff70432b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.847277:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff70432b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.847290:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff70432b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.847352:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704324 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c2a expref: 41 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.847372:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff70432b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c2a expref: 40 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.847381:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948942ffd800) 00010000:00010000:2.0:1788813310.847384:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813310.847388:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc09600, rc 0) 00000100:00100000:2.0:1788813310.847520:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+40:15675:x1875706301784960:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 1179us (1665us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788813310.847529:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 60 00000100:00100000:1.0:1788813310.864401:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813310.865125:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301785216 00000100:00100000:2.0:1788813310.865137:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301785216 00000100:00100000:2.0:1788813310.865251:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 61 00000100:00100000:2.0:1788813310.865262:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+40:15675:x1875706301785216:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788813310.865327:0:17161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813310.865355:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff70432b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c2a expref: 40 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865376:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948942ffd800) 00010000:00010000:2.0:1788813310.865404:0:17161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813310.865427:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704339 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865441:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704339 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865451:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704339 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865465:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704340 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4d4e5333 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865472:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704340 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4d4e5333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865479:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704340 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4d4e5333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865686:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704339 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865694:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704339 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865701:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704339 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865707:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813310.865711:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704339 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865719:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704339 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865737:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948a6fe50e00) 00010000:00010000:2.0:1788813310.865739:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813310.865744:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704339 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865750:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff704339 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865760:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704340 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4d4e5333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865766:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704340 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4d4e5333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865772:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704340 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4d4e5333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865778:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813310.865781:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704340 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4d4e5333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865786:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704340 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4d4e5333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865794:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4d4e5333 (ffff948942ffd600) 00010000:00010000:2.0:1788813310.865796:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813310.865799:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704340 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4d4e5333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.865805:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704340 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4d4e5333 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813310.865917:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+39:15675:x1875706301785216:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 655us (1525us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788813310.865925:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 61 00000100:00100000:0.0:1788813310.869816:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813310.871458:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301785344 00000100:00100000:1.0:1788813310.871473:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301785344 00000100:00100000:0.0:1788813310.872155:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 62 00000100:00100000:0.0:1788813310.872172:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+39:15675:x1875706301785344:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813310.872197:0:18693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813310.872224:0:18693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff704347 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c31 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.872300:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70434e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.872317:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70434e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.872331:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70434e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.872464:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166f200/0xf32533d6ff704347 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c31 expref: 41 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.872486:0:18693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fc00/0xf32533d6ff70434e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c31 expref: 40 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.872496:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948a6aed9e00) 00010000:00010000:0.0:1788813310.872499:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788813310.872503:0:18693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166fc00, rc 0) 00000100:00100000:0.0:1788813310.872789:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+40:15675:x1875706301785344:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 621us (2983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813310.872796:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 62 00000100:00100000:3.0:1788813310.875096:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813310.876179:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301785600 00000100:00100000:2.0:1788813310.876192:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301785600 00000100:00100000:2.0:1788813310.876299:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:2.0:1788813310.876311:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+40:15675:x1875706301785600:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788813310.876402:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704355 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.876420:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704355 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.876433:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704355 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813310.876871:0:17164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788813310.876882:0:17164:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 463895949372ns, next at 464895946392ns, rc = 0 00000004:00010000:2.0:1788813310.876956:0:17164:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbe556a5 reply state 0000000027136df1 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704355 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.876970:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704355 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.876978:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948a6aed9e00) 00010000:00010000:2.0:1788813310.876980:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788813310.876985:0:17164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813310.877196:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+42:15675:x1875706301785600:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 887us (2108us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1788813310.877222:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:3.0:1788813310.879717:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813310.879765:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301785728 00000100:00100000:3.0:1788813310.879774:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301785728 00000100:00100000:3.0:1788813310.879821:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 64 00000100:00100000:3.0:1788813310.879830:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+42:15675:x1875706301785728:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813310.879868:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813310.879889:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff70435c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c38 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.879977:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff70435c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c38 expref: 43 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.879992:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff70435c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c38 expref: 43 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.880012:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948a6aed9e00) 00010000:00010000:3.0:1788813310.880015:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813310.880019:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e5200, rc 0) 00000100:00100000:3.0:1788813310.880070:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+43:15675:x1875706301785728:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 241us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813310.880077:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 64 00000100:00100000:0.0:1788813310.885031:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813310.885123:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301785856 00000100:00100000:2.0:1788813310.885133:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301785856 00000100:00100000:2.0:1788813310.885205:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:2.0:1788813310.885217:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2396:x1875706301785856:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788813310.885505:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2396:x1875706301785856:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 Request processed in 289us (485us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788813310.885513:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00080000:0.0:1788813310.885787:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813310.888429:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813310.888564:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301786112 00000100:00100000:2.0:1788813310.888575:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301786112 00000100:00100000:2.0:1788813310.888641:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:2.0:1788813310.888652:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+43:15675:x1875706301786112:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788813310.888884:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+44:15675:x1875706301786112:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 232us (463us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788813310.888892:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11 00000100:00100000:1.0:1788813310.891227:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813310.891338:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301786368 00000100:00100000:3.0:1788813310.891348:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301786368 00000100:00100000:3.0:1788813310.891429:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:3.0:1788813310.891441:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+44:15675:x1875706301786368:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788813310.891567:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+44:15675:x1875706301786368:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 128us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813310.891575:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:0.0:1788813310.897330:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813310.897497:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301786496 00000100:00100000:2.0:1788813310.897517:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301786496 00000100:00100000:2.0:1788813310.897658:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 66 00000100:00100000:2.0:1788813310.897670:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+44:15675:x1875706301786496:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813310.897690:0:18693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813310.897711:0:18693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704363 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c3f expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.897781:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff70436a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.897809:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff70436a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.897819:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff70436a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813310.897865:0:18693:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788813310.897887:0:18693:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff70436a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.897913:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff704363 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c3f expref: 46 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.897993:0:18693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff70436a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c3f expref: 45 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.898002:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948a6aed9e00) 00010000:00010000:2.0:1788813310.898005:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788813310.898009:0:18693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08000, rc 0) 00000100:00100000:2.0:1788813310.898063:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+45:15675:x1875706301786496:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 395us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813310.898070:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 66 00000100:00100000:0.0:1788813310.900616:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813310.900700:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301786624 00000100:00100000:3.0:1788813310.900711:0:19582:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301786624 00000100:00100000:3.0:1788813310.900781:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:3.0:1788813310.900791:0:19582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:39adb0c8-c140-4b12-b8dc-f0861ff799f7+6:2397:x1875706301786624:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813310.900808:0:19582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813310.900829:0:19582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff704371 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c46 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813310.900854:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f1fff, blocks: 0x0 00010000:00010000:3.0:1788813310.900870:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1788813310.900873:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813310.900880:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff704371 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c46 expref: 7 pid: 19582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.900894:0:19582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff704371 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c46 expref: 7 pid: 19582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.900904:0:19582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a821e4200, rc 0) 00000100:00100000:3.0:1788813310.900969:0:19582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:2397:x1875706301786624:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 181us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813310.900974:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:0.0:1788813310.903762:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813310.903847:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301786880 00000100:00100000:3.0:1788813310.903856:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301786880 00000100:00100000:3.0:1788813310.903913:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:3.0:1788813310.903923:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+45:15675:x1875706301786880:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788813310.904110:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+45:15675:x1875706301786880:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 188us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813310.904117:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:0.0:1788813310.906737:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813310.906825:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301787008 00000100:00100000:1.0:1788813310.906833:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301787008 00000100:00100000:1.0:1788813310.906884:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 68 00000100:00100000:1.0:1788813310.906894:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+45:15675:x1875706301787008:12345-192.168.202.13@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788813310.908504:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1788813310.908586:0:17142:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788813310.908657:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788813310.908985:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+20:15675:x1875706301787008:12345-192.168.202.13@tcp:44:lhsmtool_posix.0 Request processed in 2088us (2249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813310.908996:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 68 00010000:00010000:2.0:1788813310.909171:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb200/0xf32533d6ff704187 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.909184:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb200/0xf32533d6ff704187 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.909192:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb200/0xf32533d6ff704187 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.909209:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a44cdb200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813310.909214:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb200/0xf32533d6ff704187 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.909222:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb200/0xf32533d6ff704187 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.909237:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948a6fe50e00) 00010000:00010000:2.0:1788813310.909240:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788813310.909245:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb200/0xf32533d6ff704187 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.909376:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff704133 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.909385:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff704133 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.909391:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff704133 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.909397:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813310.909400:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff704133 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.909407:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff704133 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.909416:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff948a6fe50500) 00010000:00010000:0.0:1788813310.909419:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813310.909422:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff704133 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.909428:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657000/0xf32533d6ff704133 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.909449:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff70413a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.909455:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff70413a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.909461:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff70413a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.909476:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a40030800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813310.909480:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff70413a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.909487:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff70413a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.909495:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948a6fe50e00) 00010000:00010000:0.0:1788813310.909497:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813310.909500:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff70413a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.909506:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a40030800/0xf32533d6ff70413a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.909590:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a44cdb200/0xf32533d6ff704187 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813310.909676:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313381248:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788813310.909734:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813310.909836:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313381248 00000100:00100000:2.0:1788813310.909844:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313381248 00000100:00100000:2.0:1788813310.909890:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813310.909899:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875706313381248:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788813310.910593:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fa00/0xf32533d6ff7041e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910604:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fa00/0xf32533d6ff7041e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910609:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fa00/0xf32533d6ff7041e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910614:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a4166fa00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813310.910617:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fa00/0xf32533d6ff7041e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910624:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fa00/0xf32533d6ff7041e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910647:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff948a6aed9700) 00010000:00010000:0.0:1788813310.910649:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813310.910653:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fa00/0xf32533d6ff7041e2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910659:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166fa00/0xf32533d6ff7041e2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910675:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704267 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910680:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704267 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910685:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704267 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910689:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948943657c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813310.910692:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704267 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910697:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704267 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910703:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:0.0:1788813310.910705:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813310.910708:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704267 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910713:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948943657c00/0xf32533d6ff704267 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910731:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70428a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910737:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70428a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910743:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70428a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910748:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813310.910750:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70428a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910757:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70428a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910763:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:0.0:1788813310.910766:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813310.910768:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70428a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910773:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5600/0xf32533d6ff70428a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910782:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7042d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910787:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7042d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910792:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7042d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910802:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09000 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813310.910804:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7042d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910810:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7042d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910817:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:0.0:1788813310.910819:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813310.910821:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7042d0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910826:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09000/0xf32533d6ff7042d0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910836:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704355 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910842:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704355 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910846:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704355 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910851:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08e00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:0.0:1788813310.910853:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704355 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910859:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704355 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910875:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948a6aed9e00) 00010000:00010000:0.0:1788813310.910878:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788813310.910881:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704355 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.910886:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff704355 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813310.911365:0:18668:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788813310.911370:0:18668:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788813310.911372:0:18668:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788813310.911374:0:18668:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788813311 -> 1788813311 00002000:00010000:2.0:1788813310.911376:0:18668:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788813310.911487:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3627:x1875706313381248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1587us (1750us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788813310.911495:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:3.0:1788813310.913592:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94894334d880/2, rc 0, transno 8589934596 00000100:00100000:3.0:1788813310.913606:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313381248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788813310.913757:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813310.913841:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301787136 00000100:00100000:3.0:1788813310.913847:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301787136 00000100:00100000:3.0:1788813310.913915:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:3.0:1788813310.913922:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:2396:x1875706301787136:12345-192.168.202.13@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788813310.914028:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:2396:x1875706301787136:12345-192.168.202.13@tcp:16:lhsmtool_posix.0 Request processed in 106us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813310.914033:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 24 00000100:00100000:1.0:1788813310.919921:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813310.920224:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301787392 00000100:00100000:3.0:1788813310.920235:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301787392 00000100:00100000:3.0:1788813310.920368:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 69 00000100:00100000:3.0:1788813310.920376:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+14:15675:x1875706301787392:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788813310.920432:0:17161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813310.920459:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff70436a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c3f expref: 14 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.920479:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948a6aed9e00) 00010000:00010000:3.0:1788813310.920485:0:17161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813310.920518:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff704378 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.920624:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff704378 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.920634:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff704378 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813310.920757:0:17161:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050f543b3 reply state 00000000d4e78604 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff704378 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.920769:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5e00/0xf32533d6ff704378 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.920775:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948a6aed9e00) 00010000:00010000:3.0:1788813310.920777:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788813310.920779:0:17161:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813310.920894:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+15:15675:x1875706301787392:12345-192.168.202.13@tcp:36:lhsmtool_posix.0 Request processed in 519us (983us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788813310.920900:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 69 00000100:00100000:0.0:1788813310.924817:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813310.924900:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301787520 00000100:00100000:2.0:1788813310.924927:0:18671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301787520 00000100:00100000:2.0:1788813310.925021:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:2.0:1788813310.925039:0:18671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:15675:x1875706301787520:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813310.925056:0:18671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813310.925077:0:18671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005077bac6/0xf32533d6ff70437f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c4d expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.925110:0:18671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff704371 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c46 expref: 8 pid: 19582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.925118:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813310.925123:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813310.925127:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005077bac6/0xf32533d6ff70437f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c4d expref: 8 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.925159:0:18671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff704371 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c46 expref: 8 pid: 19582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.925172:0:18671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff704371 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c46 expref: 8 pid: 19582 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813310.925186:0:18671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944173480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18671:1875706313381376:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813310.925267:0:18671:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe3e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788813310.928222:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813310.928308:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301787648 00000100:00100000:3.0:1788813310.928317:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301787648 00010000:00010000:3.0:1788813310.928368:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff704371 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c46 expref: 9 pid: 19582 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813310.928414:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:3.0:1788813310.928425:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+9:2397:x1875706301787648:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813310.928442:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813310.928466:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff704371 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c46 expref: 9 pid: 19582 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.928513:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff704371 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c46 expref: 9 pid: 19582 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.928541:0:17149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813310.928545:0:17149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813310.928561:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005077bac6/0xf32533d6ff70437f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c4d expref: 9 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.928572:0:17149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005077bac6/0xf32533d6ff70437f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c4d expref: 9 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.928608:0:17149:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005077bac6/0xf32533d6ff70437f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c4d expref: 9 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813310.928621:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17149:1875706313381504:192.168.202.13@tcp:105: 00000100:00100000:3.0:1788813310.928707:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894238c840 going to sleep for 11 seconds 00010000:00010000:2.0:1788813310.929111:0:18671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e1dd91f/0xf32533d6ff704371 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c46 expref: 9 pid: 19582 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813310.929134:0:18671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944173480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18671:1875706313381376:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813310.929152:0:18671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005077bac6/0xf32533d6ff70437f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c4d expref: 8 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.929159:0:18671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08c00, rc 0) 00000100:00100000:2.0:1788813310.929201:0:18671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+8:15675:x1875706301787520:12345-192.168.202.13@tcp:101:lhsmtool_posix.0 Request processed in 4165us (4395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813310.929207:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 25 00000100:00100000:3.0:1788813310.933640:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17149:1875706313381504:192.168.202.13@tcp:105: 00010000:00010000:3.0:1788813310.933666:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813310.933725:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:2397:x1875706301787648:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 5300us (5509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813310.933735:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 20 00000100:00100000:1.0:1788813310.934975:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813310.935007:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301787776 00000100:00100000:2.0:1788813310.935016:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301787776 00000100:00100000:2.0:1788813310.935074:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 26 00000100:00100000:2.0:1788813310.935084:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:2397:x1875706301787776:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788813310.935221:0:18668:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788813310.935225:0:18668:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788813310 00002000:00010000:2.0:1788813310.935228:0:18668:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788813309 00002000:00010000:2.0:1788813310.935230:0:18668:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788813311 -> 1788813310 00002000:00010000:2.0:1788813310.935232:0:18668:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788813310.935338:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+8:2397:x1875706301787776:12345-192.168.202.13@tcp:2:lhsmtool_posix.0 Request processed in 254us (367us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788813310.935345:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 26 00000100:00100000:0.0:1788813310.947183:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813310.947293:0:19191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301787904 00000100:00100000:3.0:1788813310.947305:0:19191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301787904 00000100:00100000:3.0:1788813310.947371:0:19191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 27 00000100:00100000:3.0:1788813310.947396:0:19191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+8:2396:x1875706301787904:12345-192.168.202.13@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788813310.947447:0:19191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704386 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.947469:0:19191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005077bac6/0xf32533d6ff70437f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c4d expref: 8 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.947478:0:19191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813310.947482:0:19191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813310.947487:0:19191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704386 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.947531:0:19191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005077bac6/0xf32533d6ff70437f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c4d expref: 8 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.947547:0:19191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005077bac6/0xf32533d6ff70437f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c4d expref: 8 pid: 18671 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813310.947571:0:19191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19191:1875706313381632:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788813310.947657:0:19191:0:(client.c:2716:ptlrpc_set_wait()) set ffff94894238c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788813310.950415:0:19191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489419b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19191:1875706313381632:192.168.202.13@tcp:104: 00010000:00010000:3.0:1788813310.950446:0:19191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704386 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813310.953154:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813310.953287:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301788032 00000100:00100000:2.0:1788813310.953298:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301788032 00010000:00010000:2.0:1788813310.953341:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005077bac6/0xf32533d6ff70437f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c4d expref: 9 pid: 18671 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813310.953414:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 21 00000100:00100000:2.0:1788813310.953426:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+9:2396:x1875706301788032:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813310.953441:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813310.953464:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005077bac6/0xf32533d6ff70437f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c4d expref: 9 pid: 18671 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.953478:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005077bac6/0xf32533d6ff70437f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c4d expref: 9 pid: 18671 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.953501:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005077bac6/0xf32533d6ff70437f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c4d expref: 9 pid: 18671 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.953532:0:17148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813310.953537:0:17148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813310.953543:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704386 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.953564:0:17148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704386 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.953595:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813310.953655:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+8:2396:x1875706301788032:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 231us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813310.953662:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 21 00010000:00010000:3.0:1788813310.954322:0:19191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704386 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.954342:0:19191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704386 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.954371:0:19191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704386 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.954379:0:19191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704386 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.954386:0:19191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704386 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.954393:0:19191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:3.0:1788813310.954398:0:19191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704386 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.954406:0:19191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704386 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.954418:0:19191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704386 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.954426:0:19191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f80fd231/0xf32533d6ff704386 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813310.954511:0:19191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:2396:x1875706301787904:12345-192.168.202.13@tcp:1:lhsmtool_posix.0 Request processed in 7117us (7338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813310.954528:0:19191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 27 00000100:00100000:0.0:1788813310.972070:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813310.972223:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301788288 00000100:00100000:2.0:1788813310.972235:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301788288 00000100:00100000:2.0:1788813310.972301:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 70 00000100:00100000:2.0:1788813310.972313:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+15:15675:x1875706301788288:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788813310.972411:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff70438d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.972430:0:18693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff704260 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729beb expref: 15 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.972440:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff70438d lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.972474:0:18693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff704260 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729beb expref: 15 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.972499:0:18693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff704260 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729beb expref: 15 pid: 17164 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813310.972521:0:18693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944173480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18693:1875706313381760:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813310.972613:0:18693:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe3eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813310.977251:0:18693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944173480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18693:1875706313381760:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813310.977285:0:18693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff70438d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813310.985362:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813310.985534:0:20304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301788416 00000100:00100000:0.0:1788813310.985545:0:20304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301788416 00010000:00010000:0.0:1788813310.985595:0:20304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff704260 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729beb expref: 16 pid: 17164 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813310.985640:0:20304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 22 00000100:00100000:0.0:1788813310.985650:0:20304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+16:2397:x1875706301788416:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813310.985665:0:20304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813310.985672:0:20304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff704260 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729beb expref: 16 pid: 17164 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.985686:0:20304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff704260 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729beb expref: 16 pid: 17164 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.985724:0:20304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a4166ec00/0xf32533d6ff704260 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729beb expref: 16 pid: 17164 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.985742:0:20304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:0.0:1788813310.985748:0:20304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c1c expref: 15 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.985758:0:20304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff70438d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.985765:0:20304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff70438d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.985773:0:20304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff70438d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813310.985806:0:20304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813310.985868:0:20304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+15:2397:x1875706301788416:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 219us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813310.985876:0:20304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 22 00010000:00010000:2.0:1788813310.986218:0:18693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff70438d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.986227:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff70438d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.986440:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704394 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.986454:0:18693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff70435c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c38 expref: 15 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.986461:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704394 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.986492:0:18693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff70435c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c38 expref: 15 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.986506:0:18693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff70435c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c38 expref: 15 pid: 17161 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813310.986520:0:18693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944173480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18693:1875706313381888:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788813310.986587:0:18693:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe3e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788813310.991712:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813310.991812:0:18693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944173480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18693:1875706313381888:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788813310.991841:0:18693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704394 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813310.992583:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301788544 00000100:00100000:3.0:1788813310.992592:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301788544 00010000:00010000:3.0:1788813310.992638:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff70435c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c38 expref: 16 pid: 17161 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813310.992677:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 23 00000100:00100000:3.0:1788813310.992687:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a777d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+16:2396:x1875706301788544:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813310.992701:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813310.992708:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff70435c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c38 expref: 16 pid: 17161 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.992719:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff70435c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c38 expref: 16 pid: 17161 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.992742:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff70435c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c38 expref: 16 pid: 17161 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.992759:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948a6aed9e00) 00010000:00010000:3.0:1788813310.992764:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704394 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.992773:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704394 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.992795:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704394 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813310.992829:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813310.992882:0:18693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704394 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813310.992890:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704394 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813310.992903:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a777d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+15:2396:x1875706301788544:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 218us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813310.992910:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 23 00000001:00080000:2.0:1788813310.993019:0:18693:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788813310.993192:0:18693:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788813310.993230:0:18693:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1788813310.993311:0:18693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948944173480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18693:1875706313382016:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788813310.993358:0:18693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813310.993391:0:18693:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe3e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813310.994370:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313382016 00000100:00100000:3.0:1788813310.994380:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313382016 00000100:00100000:3.0:1788813310.994445:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788813310.994455:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18693:x1875706313382016:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788813310.994617:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18693:x1875706313382016:12345-0@lo:1000:mdt00_003.0 Request processed in 163us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813310.994624:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788813310.994812:0:18693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948944173480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18693:1875706313382016:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788813310.995176:0:18693:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1788813310.995245:0:18693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18693:1875706313382144:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788813310.995306:0:18693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813310.995644:0:18693:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe3eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813311.001456:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313382144 00000100:00100000:3.0:1788813311.001477:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313382144 00000100:00100000:3.0:1788813311.001577:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788813311.001591:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:18693:x1875706313382144:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788813311.002568:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:18693:x1875706313382144:12345-0@lo:1000:mdt00_003.0 Request processed in 965us (7245us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788813311.002579:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788813311.002750:0:18693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18693:1875706313382144:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788813311.002806:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704394 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.002819:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704394 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.002827:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704394 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.002833:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc09600 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813311.002838:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704394 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.002848:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704394 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.002867:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948a6aed9e00) 00010000:00010000:2.0:1788813311.002870:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813311.002890:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704394 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.002897:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc09600/0xf32533d6ff704394 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.002955:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff7042ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.002962:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff7042ec lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.002967:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff7042ec lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.002972:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813311.002974:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff7042ec lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.002980:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff7042ec lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.002989:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:2.0:1788813311.002991:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813311.002998:0:18693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c1c expref: 18 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.003010:0:18693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042f3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c1c expref: 18 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.003020:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c1c expref: 18 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.003092:0:18693:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4e00/0xf32533d6ff7042f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c1c expref: 18 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813311.003107:0:18693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18693:1875706313382272:192.168.202.13@tcp:105: 00000100:00100000:2.0:1788813311.003192:0:18693:0:(client.c:2716:ptlrpc_set_wait()) set ffff948a6fe3ea80 going to sleep for 11 seconds 00000100:00080000:1.0:1788813311.003366:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813311.010498:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813311.010907:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301788672 00000100:00100000:3.0:1788813311.010919:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301788672 00000100:00100000:3.0:1788813311.011006:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12 00000100:00100000:3.0:1788813311.011017:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+19:15674:x1875706301788672:12345-192.168.202.13@tcp:49:bash.0 00000100:00100000:3.0:1788813311.011147:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+19:15674:x1875706301788672:12345-192.168.202.13@tcp:49:bash.0 Request processed in 132us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813311.011170:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12 00000100:00100000:3.0:1788813311.016081:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813311.016284:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301788800 00000100:00100000:0.0:1788813311.016297:0:18671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301788800 00000100:00100000:0.0:1788813311.016359:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:0.0:1788813311.016371:0:18671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+7:15674:x1875706301788800:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788813311.016389:0:18671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813311.016410:0:18671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003035cccc/0xf32533d6ff70439b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c54 expref: -99 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813311.016455:0:18671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f1ffe, atime: 0x6a9f1ffd, ctime: 0x6a9f1ffe, blocks: 0x0 00010000:00010000:0.0:1788813311.016479:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788813311.016484:0:18671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813311.016495:0:18671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003035cccc/0xf32533d6ff70439b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c54 expref: 8 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813311.016523:0:18671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003035cccc/0xf32533d6ff70439b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c54 expref: 8 pid: 18671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813311.016537:0:18671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a4166f000, rc 0) 00000100:00100000:0.0:1788813311.016602:0:18671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:39adb0c8-c140-4b12-b8dc-f0861ff799f7+8:15674:x1875706301788800:12345-192.168.202.13@tcp:101:bash.0 Request processed in 233us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813311.016610:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:0.0:1788813311.020694:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813311.020904:0:18693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489433a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18693:1875706313382272:192.168.202.13@tcp:105: 00010000:00010000:2.0:1788813311.020979:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff7042ec lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.020991:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4c00/0xf32533d6ff7042ec lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021023:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7043a2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021046:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7043a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021058:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7043a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021069:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7043a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021076:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7043a2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021082:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7043a2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021106:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08800 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813311.021110:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7043a2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021117:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7043a2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021129:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:2.0:1788813311.021133:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813311.021136:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7043a2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021142:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08800/0xf32533d6ff7043a2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021153:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff70438d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021158:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff70438d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021165:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff70438d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021170:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a6fc08c00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:2.0:1788813311.021173:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff70438d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021179:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff70438d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021196:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:2.0:1788813311.021198:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788813311.021202:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff70438d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021208:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08c00/0xf32533d6ff70438d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813311.021382:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+18:15675:x1875706301788288:12345-192.168.202.13@tcp:57:lhsmtool_posix.0 Request processed in 49070us (49320us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1788813311.021393:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 70 00000020:00080000:2.0:1788813311.021400:0:18693:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788813311.021427:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301788928 00000100:00100000:2.0:1788813311.021433:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301788928 00000100:00100000:2.0:1788813311.021472:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 71 00000100:00100000:2.0:1788813311.021481:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+18:15674:x1875706301788928:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:2.0:1788813311.021501:0:18693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813311.021525:0:18693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff7043a9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c5b expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021563:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7043b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021571:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7043b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021579:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7043b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021697:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08000/0xf32533d6ff7043a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c5b expref: 20 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021712:0:18693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a6fc08e00/0xf32533d6ff7043b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c5b expref: 19 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813311.021720:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:2.0:1788813311.021722:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788813311.021725:0:18693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a6fc08e00, rc 0) 00000100:00100000:2.0:1788813311.021752:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39adb0c8-c140-4b12-b8dc-f0861ff799f7+19:15674:x1875706301788928:12345-192.168.202.13@tcp:101:bash.0 Request processed in 271us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813311.021758:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 71 00000040:00080000:1.0:1788813311.022201:0:17196:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788813311.022206:0:17196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813311.022223:0:17196:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788813311.022230:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788813311.026465:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813311.026607:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301789184 00000100:00100000:3.0:1788813311.026621:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301789184 00000100:00100000:3.0:1788813311.026686:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13 00000100:00100000:3.0:1788813311.026698:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+19:15674:x1875706301789184:12345-192.168.202.13@tcp:35:bash.0 00000001:00080000:3.0:1788813311.027004:0:17165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000001:00080000:3.0:1788813311.027113:0:17165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:3.0:1788813311.027216:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+22:15674:x1875706301789184:12345-192.168.202.13@tcp:35:bash.0 Request processed in 520us (759us total) trans 8589934631 rc 0/0 00000100:00100000:3.0:1788813311.027225:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13 00000020:00080000:3.0:1788813311.027230:0:17165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788813311.033152:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813311.033250:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301789440 00000100:00100000:3.0:1788813311.033330:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301789440 00000100:00100000:3.0:1788813311.033435:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 14 00000100:00100000:3.0:1788813311.033447:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+22:15675:x1875706301789440:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788813311.033747:0:17165:0:(mdd_object.c:4199:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788813311.033827:0:17165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00010000:00010000:3.0:1788813311.033861:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5400/0xf32533d6ff7043b7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.033879:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5400/0xf32533d6ff7043b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.033892:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5400/0xf32533d6ff7043b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.033902:0:17165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5400/0xf32533d6ff7043b7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.033926:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5400/0xf32533d6ff7043b7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.033962:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5400/0xf32533d6ff7043b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.033988:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788813311.034103:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+24:15675:x1875706301789440:12345-192.168.202.13@tcp:35:lhsmtool_posix.0 Request processed in 658us (1083us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1788813311.034112:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 14 00000020:00080000:3.0:1788813311.034118:0:17165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788813311.034177:0:19586:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813311.034185:0:19586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5400/0xf32533d6ff7043b7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813311.034192:0:19586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5400 already unused, calling callback (ffffffffc0dab8b0) 00010000:00010000:0.0:1788813311.034196:0:19586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5400/0xf32533d6ff7043b7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813311.034203:0:19586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5400/0xf32533d6ff7043b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813311.034216:0:19586:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948a6aed9e00) 00010000:00010000:0.0:1788813311.034226:0:19586:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788813311.034232:0:19586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5400/0xf32533d6ff7043b7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813311.034238:0:19586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5400/0xf32533d6ff7043b7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813311.034262:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813311.034264:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813311.034266:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813311.136267:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813311.136391:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301789696 00000100:00100000:1.0:1788813311.136402:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301789696 00000100:00100000:1.0:1788813311.136463:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:1.0:1788813311.136473:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489433a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+24:15685:x1875706301789696:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813311.136499:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813311.136521:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff7043be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x709a1244a0729c62 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813311.136646:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788813311.136745:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff7043be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c62 expref: 26 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813311.136761:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948a6fe50d00) 00010000:00010000:1.0:1788813311.136764:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813311.136770:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a7b5f9200/0xf32533d6ff7043be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0x709a1244a0729c62 expref: 26 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813311.136785:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948a7b5f9200, rc 0) 00000100:00100000:1.0:1788813311.137446:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489433a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+25:15685:x1875706301789696:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 377us (591us total) trans 8589934634 rc 301/301 00000100:00100000:1.0:1788813311.137478:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:2.0:1788813311.143874:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813311.144199:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301789824 00000100:00100000:3.0:1788813311.144211:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301789824 00000100:00100000:3.0:1788813311.144286:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 73 00000100:00100000:3.0:1788813311.144298:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+25:15685:x1875706301789824:12345-192.168.202.13@tcp:34:lfs.0 00010000:00010000:3.0:1788813311.144390:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff7043cc lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.144408:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff7043cc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.144421:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff7043cc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.144436:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4a00/0xf32533d6ff7043d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.144443:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4a00/0xf32533d6ff7043d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.144511:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4a00/0xf32533d6ff7043d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.144770:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff7043da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.144779:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff7043da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.144785:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff7043da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813311.144830:0:17161:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff7043da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.144843:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff7043cc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.144861:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff7043cc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.144869:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff7043cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.144875:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5200 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813311.144879:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff7043cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.144886:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff7043cc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.144898:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948a6fe50e00) 00010000:00010000:3.0:1788813311.144906:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813311.144911:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff7043cc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.144918:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5200/0xf32533d6ff7043cc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.145508:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4a00/0xf32533d6ff7043d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.145591:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4a00/0xf32533d6ff7043d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.145598:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4a00/0xf32533d6ff7043d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.145603:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e4a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813311.145606:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4a00/0xf32533d6ff7043d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.145613:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4a00/0xf32533d6ff7043d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.145623:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff948a7b725d00) 00010000:00010000:3.0:1788813311.145626:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813311.145630:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4a00/0xf32533d6ff7043d3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.145635:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e4a00/0xf32533d6ff7043d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.145654:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff7043da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.145668:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff7043da lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.145675:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff7043da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.145680:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948a821e5a00 already unused, calling callback (ffffffffc19d24f0) 00010000:00010000:3.0:1788813311.145683:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff7043da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.145689:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff7043da lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.145697:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948a6aed9a00) 00010000:00010000:3.0:1788813311.145699:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813311.145702:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff7043da lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813311.145707:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948a821e5a00/0xf32533d6ff7043da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813311.145865:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+25:15685:x1875706301789824:12345-192.168.202.13@tcp:34:lfs.0 Request processed in 1554us (1987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813311.145875:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 73 00000100:00100000:3.0:1788813311.152778:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788813311.152977:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301790080 00000100:00100000:1.0:1788813311.152991:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301790080 00000100:00100000:1.0:1788813311.153062:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:1.0:1788813311.153075:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+25:15685:x1875706301790080:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813311.153321:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+26:15685:x1875706301790080:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 249us (554us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1788813311.153330:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15 00000100:00100000:3.0:1788813311.335041:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313382400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788813311.335118:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813311.335567:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313382400 00000100:00100000:2.0:1788813311.335576:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313382400 00000100:00100000:2.0:1788813311.335663:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813311.335674:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489419b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313382400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788813311.335706:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788813311.335760:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489419b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313382400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813311.335767:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788813311.336042:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813311.336360:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313382400:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788813311.399929:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813312.356553:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813312.356580:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94894334df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313382528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788813312.356735:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813312.356844:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313382528 00000100:00100000:1.0:1788813312.356854:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313382528 00000100:00100000:1.0:1788813312.356921:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788813312.356963:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313382528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788813312.357003:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788813312.357072:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313382528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813312.357079:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788813312.357127:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94894334df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313382528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788813312.357593:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813312.357635:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9489443b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313382656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788813312.357674:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813312.357751:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313382656 00000100:00100000:0.0:1788813312.357756:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313382656 00000100:00100000:0.0:1788813312.357796:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788813312.357804:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948944025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313382656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788813312.357840:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788813312.357878:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948944025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313382656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813312.357884:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788813312.357971:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9489443b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313382656:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788813312.420149:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788813313.022796:0:20341:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:0.0:1788813313.444171:0:19586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813313.923011:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813313.923049:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813313.923084:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813313.923104:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813313.923121:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813313.923144:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813313.923153:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301790720 00000100:00100000:3.0:1788813313.923161:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813313.923163:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301790720 00000100:00100000:3.0:1788813313.923177:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788813313.923200:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788813313.923221:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301791232 00000100:00100000:2.0:1788813313.923225:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301791232 00000100:00100000:3.0:1788813313.923234:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301790592 00000100:00100000:3.0:1788813313.923238:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301790592 00000100:00100000:3.0:1788813313.923260:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301791104 00000100:00100000:3.0:1788813313.923263:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301791104 00000100:00100000:3.0:1788813313.923280:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 27 00000100:00100000:3.0:1788813313.923291:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2397:x1875706301790720:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813313.923363:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2397:x1875706301790720:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 74us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813313.923372:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 27 00000100:00100000:3.0:1788813313.923391:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:3.0:1788813313.923397:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+8:2397:x1875706301790592:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813313.923413:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00100000:2.0:1788813313.923419:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342c3357-8551-4188-a7af-8af88d224192+5:2397:x1875706301791104:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813313.923420:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+8:2397:x1875706301790592:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813313.923432:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 28 00000100:00100000:3.0:1788813313.923446:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:3.0:1788813313.923451:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:342c3357-8551-4188-a7af-8af88d224192+5:2397:x1875706301791232:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813313.923454:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342c3357-8551-4188-a7af-8af88d224192+5:2397:x1875706301791104:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 36us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813313.923460:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00100000:3.0:1788813313.923471:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:342c3357-8551-4188-a7af-8af88d224192+5:2397:x1875706301791232:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 21us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813313.923477:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 30 00000100:00100000:3.0:1788813313.923517:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301790464 00000100:00100000:3.0:1788813313.923521:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301790464 00000100:00100000:3.0:1788813313.923553:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301790976 00000100:00100000:3.0:1788813313.923556:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301790976 00000100:00100000:3.0:1788813313.923568:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301790336 00000100:00100000:3.0:1788813313.923570:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301790336 00000100:00100000:3.0:1788813313.923583:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301790848 00000100:00100000:3.0:1788813313.923585:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301790848 00000100:00100000:3.0:1788813313.923600:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 62 00000100:00100000:3.0:1788813313.923606:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2397:x1875706301790464:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813313.923631:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+5:2397:x1875706301790464:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813313.923637:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 62 00000100:00100000:3.0:1788813313.923650:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:3.0:1788813313.923655:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342c3357-8551-4188-a7af-8af88d224192+5:2397:x1875706301790976:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813313.923677:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342c3357-8551-4188-a7af-8af88d224192+5:2397:x1875706301790976:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 22us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813313.923683:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:3.0:1788813313.923696:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 64 00000100:00100000:3.0:1788813313.923707:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+26:2397:x1875706301790336:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813313.923737:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489435b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+26:2397:x1875706301790336:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813313.923743:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 64 00000100:00100000:3.0:1788813313.923759:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:3.0:1788813313.923764:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894424f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342c3357-8551-4188-a7af-8af88d224192+6:2397:x1875706301790848:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813313.923791:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894424f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342c3357-8551-4188-a7af-8af88d224192+6:2397:x1875706301790848:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813313.923797:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:0.0:1788813313.924268:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301790208 00000100:00100000:0.0:1788813313.924274:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301790208 00000100:00100000:0.0:1788813313.924312:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 167 00000100:00100000:0.0:1788813313.924322:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:2397:x1875706301790208:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813313.924361:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8d3a369b-b89e-4ca2-be4d-9afac76fe88b+13:2397:x1875706301790208:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 43us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813313.924376:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 167 00000100:00080000:1.0:1788813313.924561:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813313.924565:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788813313.924568:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813313.924571:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813314.404982:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313382912:0@lo:400:kworker.0 00000100:00100000:2.0:1788813314.405059:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813314.405104:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313383424:0@lo:400:kworker.0 00000100:00100000:2.0:1788813314.405122:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813314.405135:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313383936:0@lo:400:kworker.0 00000100:00100000:2.0:1788813314.405154:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813314.405180:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788813314.405185:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313382784:0@lo:400:kworker.0 00000100:00100000:2.0:1788813314.405207:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813314.405225:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313383296:0@lo:400:kworker.0 00000100:00100000:2.0:1788813314.405241:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813314.405252:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313383808:0@lo:400:kworker.0 00000100:00100000:2.0:1788813314.405282:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813314.405296:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313384320:0@lo:400:kworker.0 00000100:00100000:2.0:1788813314.405319:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813314.405342:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313382912 00000100:00100000:2.0:1788813314.405350:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313382912 00000100:00100000:2.0:1788813314.405382:0:17902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313383424 00000100:00100000:2.0:1788813314.405384:0:17902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313383424 00000100:00100000:2.0:1788813314.405396:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788813314.405409:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313382912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813314.405463:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875706313382912:12345-0@lo:400:kworker.0 Request processed in 55us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813314.405470:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788813314.405497:0:17902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788813314.405504:0:17902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313383424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813314.405539:0:17902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875706313383424:12345-0@lo:400:kworker.0 Request processed in 36us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813314.405545:0:17902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788813314.405579:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1875706313382912:0@lo:400:kworker.0 00000100:00100000:2.0:1788813314.405587:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1875706313383424:0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.405776:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313383168:0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.405809:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813314.405831:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313383680:0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.405861:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813314.405879:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313384192:0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.405899:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813314.405911:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788813314.405917:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313383040:0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.405956:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813314.405972:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313383552:0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.405989:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813314.406001:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a6eb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313384064:0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406016:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813314.406038:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313383936 00000100:00100000:1.0:1788813314.406042:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313383936 00000100:00100000:1.0:1788813314.406069:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313383296 00000100:00100000:1.0:1788813314.406072:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313383296 00000100:00100000:1.0:1788813314.406082:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313383808 00000100:00100000:1.0:1788813314.406084:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313383808 00000100:00100000:1.0:1788813314.406092:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313384320 00000100:00100000:1.0:1788813314.406094:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313384320 00000100:00100000:1.0:1788813314.406103:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313384192 00000100:00100000:1.0:1788813314.406105:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313384192 00000100:00100000:1.0:1788813314.406114:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313384064 00000100:00100000:1.0:1788813314.406116:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313384064 00000100:00100000:1.0:1788813314.406126:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788813314.406131:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313383936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406161:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875706313383936:12345-0@lo:400:kworker.0 Request processed in 30us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813314.406167:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788813314.406177:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788813314.406188:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313383296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406212:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875706313383296:12345-0@lo:400:kworker.0 Request processed in 24us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813314.406217:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788813314.406226:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788813314.406231:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6eb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313383808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406249:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6eb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875706313383808:12345-0@lo:400:kworker.0 Request processed in 18us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813314.406254:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788813314.406262:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788813314.406267:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313384320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406284:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875706313384320:12345-0@lo:400:kworker.0 Request processed in 18us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813314.406289:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788813314.406297:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788813314.406302:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313384192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406322:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875706313384192:12345-0@lo:400:kworker.0 Request processed in 21us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813314.406328:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788813314.406336:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788813314.406341:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313384064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406359:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875706313384064:12345-0@lo:400:kworker.0 Request processed in 19us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813314.406364:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788813314.406377:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313383168 00000100:00100000:1.0:1788813314.406385:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313383168 00000100:00100000:1.0:1788813314.406408:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313383680 00000100:00100000:1.0:1788813314.406410:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313383680 00000100:00100000:1.0:1788813314.406419:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313383040 00000100:00100000:1.0:1788813314.406421:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313383040 00000100:00100000:1.0:1788813314.406430:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313383552 00000100:00100000:1.0:1788813314.406432:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313383552 00000100:00100000:1.0:1788813314.406443:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788813314.406448:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313383168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406479:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875706313383168:12345-0@lo:400:kworker.0 Request processed in 31us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813314.406496:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788813314.406507:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788813314.406513:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313383680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406550:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313383680:12345-0@lo:400:kworker.0 Request processed in 38us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813314.406556:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788813314.406566:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788813314.406572:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894334d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3626:x1875706313383040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406594:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894334d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3626:x1875706313383040:12345-0@lo:400:kworker.0 Request processed in 23us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813314.406599:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788813314.406607:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813314.406612:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94894348b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313383552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406629:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94894348b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875706313383552:12345-0@lo:400:kworker.0 Request processed in 18us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813314.406634:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788813314.406661:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813314.406665:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813314.406668:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788813314.406670:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813314.406691:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313383040:0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406699:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313383552:0@lo:400:kworker.0 00010000:00080000:1.0:1788813314.406709:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a6eb02d80 x1875706313384064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813314.406718:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1875706313384064:0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406727:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1875706313383168:0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406735:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1875706313383680:0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406743:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1875706313384192:0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406769:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875706313383296:0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406777:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875706313383808:0@lo:400:kworker.0 00010000:00080000:1.0:1788813314.406785:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948a6eb02300 x1875706313384320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813314.406794:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1875706313384320:0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.406802:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1875706313383936:0@lo:400:kworker.0 00000100:00100000:1.0:1788813314.407218:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813314.407229:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313384448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813314.407259:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813314.407317:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313384448 00000100:00100000:2.0:1788813314.407322:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313384448 00000100:00100000:2.0:1788813314.407357:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813314.407363:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948943489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1875706313384448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813314.407384:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788813314.407418:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948943489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1875706313384448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813314.407423:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788813314.407554:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1875706313384448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813314.408242:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313382784 00000100:00100000:3.0:1788813314.408248:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313382784 00000100:00100000:3.0:1788813314.408280:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788813314.408286:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a6fe7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+24:3628:x1875706313382784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813314.408332:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a6fe7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7e65740-fccd-471b-95df-6f83776cc95f+24:3628:x1875706313382784:12345-0@lo:400:kworker.0 Request processed in 47us (3124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813314.408338:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788813314.408405:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948a46544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313384576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813314.408430:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813314.408464:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313384576 00000100:00100000:3.0:1788813314.408468:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313384576 00000100:00100000:3.0:1788813314.408501:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788813314.408508:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313384576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813314.408533:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788813314.408565:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875706313384576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813314.408580:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788813314.408607:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a46544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1875706313384576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813314.408630:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948a6eb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7e65740-fccd-471b-95df-6f83776cc95f:3628:1875706313382784:0@lo:400:kworker.0 00000100:00100000:3.0:1788813314.412248:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813314.412274:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff948943124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313384704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788813314.412346:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813314.412581:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706313384704 00000100:00100000:2.0:1788813314.412590:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706313384704 00000100:00100000:2.0:1788813314.412644:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813314.412655:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff948a46544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313384704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788813314.412676:0:18673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788813314.412724:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff948a46544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875706313384704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813314.412740:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788813314.412814:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff948943124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1875706313384704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788813314.448072:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813314.448120:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788813314.448179:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301791488 00000100:00100000:0.0:1788813314.448189:0:18670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301791488 00000100:00100000:0.0:1788813314.448244:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00100000:0.0:1788813314.448254:0:18670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+8:2396:x1875706301791488:12345-192.168.202.13@tcp:16:kworker.0 00000100:00100000:0.0:1788813314.448373:0:18670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39adb0c8-c140-4b12-b8dc-f0861ff799f7+8:2396:x1875706301791488:12345-192.168.202.13@tcp:16:kworker.0 Request processed in 120us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813314.448380:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 29 00000100:00100000:3.0:1788813314.450087:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706301791360 00000100:00100000:3.0:1788813314.450100:0:18674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706301791360 00002000:00100000:3.0:1788813314.450140:0:18674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff9489443b6300 x1875706301791360/t0(0) o4->39adb0c8-c140-4b12-b8dc-f0861ff799f7@192.168.202.13@tcp:130/0 lens 504/0 e 0 to 0 dl 1788813325 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788813314.450152:0:18674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9489443b6300 with x1875706301791360 ext(0->8) 00002000:00010000:3.0:1788813314.450158:0:18674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9489443b6300 00000100:00100000:3.0:1788813314.450201:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 0 00000100:00100000:3.0:1788813314.450210:0:18674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9489443b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+8:2396:x1875706301791360:12345-192.168.202.13@tcp:4:bash.0 00000100:00100000:3.0:1788813314.452740:0:18674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9489443b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:39adb0c8-c140-4b12-b8dc-f0861ff799f7+10:2396:x1875706301791360:12345-192.168.202.13@tcp:4:bash.0 Request processed in 2519us (4665us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788813314.452754:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 0 00002000:00100000:3.0:1788813314.452767:0:18674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff9489443b6300 x1875706301791360/t8589934599(0) o4->39adb0c8-c140-4b12-b8dc-f0861ff799f7@192.168.202.13@tcp:130/0 lens 504/448 e 0 to 0 dl 1788813325 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788813314.452778:0:18674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9489443b6300 with x1875706301791360 ext(0->8) 00002000:00010000:3.0:1788813314.452783:0:18674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9489443b6300 00010000:00010000:3.0:1788813314.469284:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42075 lines, 42075 kept, 0 dropped, 0 bad.